Jun 19 04:06:26 devstack cinder-volume[82476]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 19 04:06:26 devstack cinder-volume[82476]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:06:26 devstack cinder-volume[82476]: we strongly recommend against using it for new projects. Jun 19 04:06:26 devstack cinder-volume[82476]: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:06:26 devstack cinder-volume[82476]: framework. For more detail see Jun 19 04:06:26 devstack cinder-volume[82476]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:06:26 devstack cinder-volume[82476]: import eventlet # noqa Jun 19 04:06:29 devstack cinder-volume[82476]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:06:29 devstack cinder-volume[82476]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:06:29 devstack cinder-volume[82476]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:06:30 devstack cinder-volume[82476]: INFO dbcounter [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Registered counter for database cinder Jun 19 04:06:30 devstack cinder-volume[82476]: DEBUG oslo_db.sqlalchemy.engines [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:06:30 devstack cinder-volume[82476]: DEBUG dbcounter [-] [82476] Writer thread running {{(pid=82476) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:06:30 devstack cinder-volume[82476]: INFO cinder.rpc [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 19 04:06:30 devstack cinder-volume[82476]: INFO cinder.rpc [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 19 04:06:30 devstack cinder-volume[82476]: DEBUG oslo_db.sqlalchemy.engines [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:06:30 devstack cinder-volume[82476]: INFO cinder.volume.manager [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Determined volume DB was empty at startup. Jun 19 04:06:30 devstack cinder-volume[82476]: DEBUG cinder.volume.manager [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82476) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 19 04:06:30 devstack cinder-volume[82476]: INFO cinder.volume.manager [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 19 04:06:30 devstack cinder-volume[82476]: WARNING stevedore.named [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 04:06:30 devstack cinder-volume[82476]: WARNING castellan.key_manager [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:06:30 devstack cinder-volume[82476]: WARNING cinder.keymgr.conf_key_mgr [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:06:30 devstack cinder-volume[82476]: DEBUG cinder.volume.drivers.lvm [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82476) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 19 04:06:30 devstack cinder-volume[82476]: DEBUG oslo_concurrency.processutils [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_concurrency.processutils [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] CMD "cinder-rtstool verify" returned: 0 in 0.462s {{(pid=82476) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_db.sqlalchemy.engines [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:06:31 devstack cinder-volume[82476]: INFO cinder.rpc [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 19 04:06:31 devstack cinder-volume[82476]: INFO cinder.rpc [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 19 04:06:31 devstack cinder-volume[82476]: WARNING stevedore.named [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 04:06:31 devstack cinder-volume[82476]: WARNING castellan.key_manager [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:06:31 devstack cinder-volume[82476]: INFO cinder.volume.manager [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_db.sqlalchemy.engines [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82476) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:06:31 devstack cinder-volume[82476]: INFO oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Starting 1 workers Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Started child 82640 {{(pid=82476) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Full set of CONF: {{(pid=82476) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] ******************************************************************************** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Configuration options gathered from: {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] ================================================================================ {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] allow_availability_zone_fallback = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] allow_compression_on_image_upload = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] allowed_direct_url_schemes = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] api_rate_limit = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] auth_strategy = keystone {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] az_cache_duration = 3600 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_availability_zone = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_host = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_stats_polling_interval = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backup_api_class = cinder.backup.api.API {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backup_name_template = backup-%s {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backup_use_same_host = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backup_use_temp_snapshot = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82640]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] chap_password = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] chap_username = {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cinder_internal_tenant_project_id = aa121fff18fe4f409f8c799b357b5053 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cinder_internal_tenant_user_id = d5b58b6308dd4b418192207764d8a9c0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cloned_volume_same_az = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cluster = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] compression_format = gzip {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] compute_api_class = cinder.compute.nova.API {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] config_dir = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] config_source = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] control_exchange = openstack {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] debug = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] default_availability_zone = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] default_group_type = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] default_volume_type = lvmdriver-1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] disk_geometry = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] driver_client_cert = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] driver_client_cert_key = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] driver_data_namespace = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] driver_ssl_cert_path = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] driver_ssl_cert_verify = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] driver_use_ssl = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] enable_force_upload = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] enable_new_services = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] enable_unsupported_driver = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] enabled_backends = ['lvmdriver-1'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] enforce_multipath_for_image_xfer = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] filter_function = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance_api_insecure = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance_api_servers = ['http://192.168.122.132/image'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance_api_ssl_compression = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance_ca_certificates_file = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance_catalog_info = image:glance:publicURL {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance_certfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance_keyfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance_num_retries = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance_request_timeout = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] goodness_function = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] graceful_shutdown_timeout = 5 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] group_api_class = cinder.group.api.API {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] host = devstack {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] image_compress_on_upload = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] image_conversion_address_space_limit = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] image_conversion_cpu_limit = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] image_conversion_disable = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] image_upload_use_cinder_backend = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] image_upload_use_internal_tenant = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] image_volume_cache_enabled = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] image_volume_cache_max_count = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] image_volume_cache_max_size_gb = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] init_host_max_objects_retrieval = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] instance_format = [instance: %(uuid)s] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] iscsi_target_flags = {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] iscsi_write_cache = on {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] iser_helper = tgtadm {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] iser_ip_address = 192.168.122.132 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] iser_port = 3260 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] log_color = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] log_config_append = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] log_dir = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] log_file = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] log_options = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] log_rotate_interval = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] log_rotate_interval_type = days {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] log_rotation_type = none {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] max_age = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] max_logfile_count = 30 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] max_logfile_size_mb = 200 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] max_over_subscription_ratio = 20.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] message_reap_interval = 86400 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] message_ttl = 2592000 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] migration_create_volume_timeout_secs = 300 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] monkey_patch = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] monkey_patch_modules = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] my_ip = 192.168.122.132 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] no_snapshot_gb_quota = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] num_iser_scan_tries = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] num_shell_tries = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] num_volume_device_scan_tries = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] nvmeof_conn_info_version = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] nvmet_ns_id = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] nvmet_port_id = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] osapi_max_limit = 1000 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] osapi_volume_ext_list = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] osapi_volume_listen = 0.0.0.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] osapi_volume_listen_port = 8776 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] osapi_volume_use_ssl = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] osapi_volume_workers = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] per_volume_size_limit = -1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] periodic_fuzzy_delay = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] periodic_interval = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] project_id_regex = [0-9a-f\-]+ {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] public_endpoint = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] publish_errors = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] quota_backup_gigabytes = 1000 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] quota_backups = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] quota_gigabytes = 1000 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] quota_groups = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] quota_snapshots = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] quota_volumes = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] rate_limit_burst = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] rate_limit_except_level = CRITICAL {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] rate_limit_interval = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] reinit_driver_count = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] replication_device = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] report_discard_supported = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] report_interval = 120 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] reservation_clean_interval = 86400 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] reservation_expire = 86400 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] reserved_image_namespaces = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] reserved_percentage = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] rpc_response_timeout = 120 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] run_external_periodic_tasks = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] scst_target_driver = iscsi {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] scst_target_iqn_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] service_down_time = 720 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] shell_completion = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] snapshot_name_template = snapshot-%s {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] snapshot_same_host = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] split_loggers = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] state_path = /opt/stack/data/cinder {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] storage_availability_zone = nova {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] storage_protocol = iSCSI {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] syslog_log_facility = LOG_USER {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] target_helper = lioadm {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] target_ip_address = 192.168.122.132 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] target_port = 3260 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] target_protocol = iscsi {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] target_secondary_ip_addresses = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] trace_flags = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] transfer_api_class = cinder.transfer.api.API {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] transport_url = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] until_refresh = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] use_chap_auth = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] use_default_quota_class = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] use_journal = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] use_json = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] use_multipath_for_image_xfer = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] use_stderr = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] use_syslog = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] verify_glance_signatures = enabled {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] volume_api_class = cinder.volume.api.API {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] volume_backend_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] volume_clear = zero {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] volume_clear_ionice = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] volume_clear_size = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82640]: INFO cinder.volume.manager [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] volume_copy_bps_limit = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] volume_dd_blocksize = 1M {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] volume_name_template = volume-%s {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] volume_service_inithost_offload = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] volume_usage_audit_period = month {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] zoning_mode = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_concurrency.disable_process_locking = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.auth_section = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.auth_type = password {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.auth_version = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.cache = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.certfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.delay_auth_decision = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.http_connect_timeout = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.include_service_catalog = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.insecure = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.interface = public {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.keyfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_password = {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcache_username = {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.region_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.service_token_roles_required = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.service_type = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.token_cache_time = 300 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.backend = dogpile.cache.null {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.backend_argument = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.backend_expiration_time = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.config_prefix = cache.oslo {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.debug_cache_backend = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.enable_retry_client = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.enable_socket_keepalive = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.enabled = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.expiration_time = 600 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.hashclient_retry_attempts = 2 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.memcache_dead_retry = 300 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.memcache_pool_maxsize = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.memcache_sasl_enabled = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.password = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.proxies = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.redis_db = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.redis_sentinel_service_name = mymaster {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.redis_server = localhost:6379 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.retry_attempts = 2 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.retry_delay = 0.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.socket_keepalive_count = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.socket_keepalive_idle = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.socket_keepalive_interval = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.socket_timeout = 1.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.tls_allowed_ciphers = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.tls_cafile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.tls_certfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.tls_enabled = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.tls_keyfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cache.username = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] coordination.backend_url = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.asyncio_connection = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.asyncio_slave_connection = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.backend = sqlalchemy {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.connection = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.connection_debug = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.connection_parameters = {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.connection_recycle_time = 3600 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.connection_trace = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:31 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.db_inc_retry_interval = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.db_max_retries = 20 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.db_max_retry_interval = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.db_retry_interval = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.max_overflow = 50 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.max_pool_size = 5 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.max_retries = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.mysql_wsrep_sync_wait = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.pool_timeout = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.retry_interval = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.slave_connection = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.sqlite_synchronous = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.synchronous_reader = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] database.use_db_reconnect = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] profiler.connection_string = messaging:// {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] profiler.enabled = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:31 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] profiler.es_doc_type = notification {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] profiler.es_scroll_size = 10000 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] profiler.es_scroll_time = 2m {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] profiler.filter_error_trace = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] profiler.hmac_keys = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] profiler.sentinel_service_name = mymaster {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] profiler.socket_timeout = 0.1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] profiler.trace_requests = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] profiler.trace_sqlalchemy = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] profiler_jaeger.process_tags = {} {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] profiler_jaeger.service_name_prefix = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] profiler_otlp.service_name_prefix = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_policy.enforce_new_defaults = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: WARNING oslo_config.cfg [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_policy.enforce_scope = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_policy.policy_default_rule = default {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_policy.policy_file = policy.yaml {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_policy.remote_timeout = 60.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] privsep_osbrick.group = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack sudo[82645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 19 04:06:31 devstack sudo[82645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] privsep_osbrick.helper_command = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] privsep_osbrick.user = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cinder_sys_admin.group = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cinder_sys_admin.helper_command = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] cinder_sys_admin.user = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] service_user.auth_section = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] service_user.auth_type = password {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] service_user.cafile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] service_user.certfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] service_user.collect_timing = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] service_user.insecure = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] service_user.keyfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] service_user.send_service_user_token = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] service_user.split_loggers = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] service_user.timeout = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance.auth_section = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance.auth_type = password {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance.certfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance.collect_timing = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance.insecure = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance.keyfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance.region_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance.split_loggers = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] glance.timeout = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.backend_availability_zone = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.chap_password = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.chap_username = {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.disk_geometry = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.driver_client_cert = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.driver_client_cert_key = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.driver_data_namespace = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.driver_use_ssl = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.enable_unsupported_driver = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.extra_capabilities = {} {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.filter_function = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.goodness_function = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.iscsi_target_flags = {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.iscsi_write_cache = on {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.iser_helper = tgtadm {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.iser_port = 3260 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.lvm_mirrors = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.lvm_share_target = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.lvm_type = auto {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.num_shell_tries = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.nvmet_port_id = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.replication_device = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.report_discard_supported = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.reserved_percentage = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.scst_target_driver = iscsi {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.scst_target_iqn_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.storage_protocol = iSCSI {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.target_helper = tgtadm {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.target_port = 3260 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.target_protocol = iscsi {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.trace_flags = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.unique_fqdn_network = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.use_chap_auth = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.volume_backend_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.volume_clear = zero {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.volume_clear_ionice = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.volume_clear_size = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.volume_group = cinder-volumes {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_reports.file_event_handler = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_reports.log_dir = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.backend_availability_zone = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.backend_host = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.chap_password = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.chap_username = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.chiscsi_conf = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.disk_geometry = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.driver_client_cert = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.driver_data_namespace = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.driver_use_ssl = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.extra_capabilities = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.filter_function = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.goodness_function = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.iser_helper = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.iser_ip_address = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.iser_port = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.iser_target_prefix = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.lvm_conf_file = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.lvm_mirrors = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.lvm_share_target = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.lvm_type = auto {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.num_shell_tries = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.nvmet_port_id = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.replication_device = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.report_discard_supported = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.reserved_percentage = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.scst_target_driver = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.storage_protocol = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.target_helper = lioadm {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.target_ip_address = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.target_port = 3260 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.target_protocol = iscsi {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.trace_flags = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.use_chap_auth = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.volume_clear = zero {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.volume_clear_size = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] lvmdriver-1.volumes_dir = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.ssl = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.ssl_version = {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_notifications.driver = [] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_notifications.retry = -1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] oslo_messaging_notifications.transport_url = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] key_manager.fixed_key = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.barbican_api_version = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.barbican_endpoint = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.barbican_endpoint_type = public {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.barbican_region_name = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.cafile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.certfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.collect_timing = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.insecure = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.keyfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.number_of_retries = 60 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.retry_delay = 1 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.send_service_user_token = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.split_loggers = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.timeout = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.verify_ssl = True {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican.verify_ssl_path = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican_service_user.auth_section = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican_service_user.auth_type = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican_service_user.cafile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican_service_user.certfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican_service_user.collect_timing = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican_service_user.insecure = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican_service_user.keyfile = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican_service_user.split_loggers = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] barbican_service_user.timeout = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] vault.approle_role_id = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] vault.approle_secret_id = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] vault.kv_mountpoint = secret {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:31 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] vault.kv_path = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:32 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] vault.kv_version = 2 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:32 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] vault.namespace = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:32 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] vault.root_token_id = **** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:32 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] vault.ssl_ca_crt_file = None {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:32 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] vault.timeout = 60.0 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:32 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] vault.use_ssl = False {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:32 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:32 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] ******************************************************************************** {{(pid=82476) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 19 04:06:32 devstack sudo[82645]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:32 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:32 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:32 devstack sudo[82804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:32 devstack sudo[82804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:33 devstack sudo[82804]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:33 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.678s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:33 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:06:33 devstack cinder-volume[82640]: INFO cinder.brick.local_dev.lvm [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 19 04:06:33 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:33 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:33 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:33 devstack sudo[83013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:06:33 devstack sudo[83013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:33 devstack sudo[83013]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:33 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.719s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:33 devstack cinder-volume[82640]: DEBUG cinder.brick.local_dev.lvm [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82640) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 19 04:06:33 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:33 devstack sudo[83210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:33 devstack sudo[83210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:35 devstack sudo[83210]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:35 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.100s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:35 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:35 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:35 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:35 devstack sudo[83412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:35 devstack sudo[83412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:35 devstack sudo[83412]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:35 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.673s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:35 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:35 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:35 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:35 devstack sudo[83425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 19 04:06:35 devstack sudo[83425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:36 devstack sudo[83425]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:36 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.692s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:36 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:36 devstack sudo[83429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:06:36 devstack sudo[83429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:37 devstack sudo[83429]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:37 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.837s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:37 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:37 devstack sudo[83441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:06:37 devstack sudo[83441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:37 devstack sudo[83441]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:37 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.668s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:37 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:37 devstack sudo[83444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:06:37 devstack sudo[83444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:38 devstack sudo[83444]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:38 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.784s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:38 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:38 devstack sudo[83450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:38 devstack sudo[83450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:39 devstack sudo[83450]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:39 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.775s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:39 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:39 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:39 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:39 devstack sudo[83458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:39 devstack sudo[83458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:40 devstack sudo[83458]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:40 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.638s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:40 devstack cinder-volume[82640]: INFO cinder.volume.drivers.lvm [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 19 04:06:40 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:40 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:40 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:40 devstack sudo[83468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:40 devstack sudo[83468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:40 devstack sudo[83468]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:40 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.799s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:40 devstack cinder-volume[82640]: DEBUG cinder.volume.drivers.lvm [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Updating volume stats {{(pid=82640) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:06:40 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:41 devstack sudo[83584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:06:41 devstack sudo[83584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:41 devstack cinder-volume[82476]: DEBUG dbcounter [-] [82476] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82476) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:06:41 devstack sudo[83584]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:41 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:41 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:41 devstack sudo[83725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:06:41 devstack sudo[83725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:42 devstack sudo[83725]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:42 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:42 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:42 devstack sudo[83729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:42 devstack sudo[83729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:42 devstack sudo[83729]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:42 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.606s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:42 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:42 devstack sudo[83732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:06:42 devstack sudo[83732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:43 devstack sudo[83732]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:43 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:43 devstack cinder-volume[82640]: INFO cinder.volume.driver [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Driver hasn't implemented _init_vendor_properties() Jun 19 04:06:43 devstack cinder-volume[82640]: DEBUG cinder.volume.driver [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82640) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 19 04:06:43 devstack cinder-volume[82640]: DEBUG oslo_db.sqlalchemy.engines [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82640) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:06:43 devstack cinder-volume[82640]: DEBUG dbcounter [-] [82640] Writer thread running {{(pid=82640) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:06:43 devstack cinder-volume[82640]: DEBUG cinder.db.api [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Building query based on filter {{(pid=82640) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 19 04:06:43 devstack cinder-volume[82640]: DEBUG cinder.image.image_utils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82640) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 19 04:06:43 devstack cinder-volume[82640]: INFO cinder.keymgr.migration [None req-ffc17251-02a0-4ef9-b57e-2b5fef5b0b4f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 19 04:06:43 devstack cinder-volume[82640]: DEBUG cinder.volume.drivers.lvm [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Updating volume stats {{(pid=82640) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:06:43 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:43 devstack sudo[83737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:06:43 devstack sudo[83737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:44 devstack sudo[83737]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:44 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:44 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:44 devstack sudo[83744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:06:44 devstack sudo[83744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:45 devstack sudo[83744]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:45 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:45 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:45 devstack sudo[83747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:45 devstack sudo[83747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:45 devstack sudo[83747]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:45 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:45 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:45 devstack sudo[83751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:06:45 devstack sudo[83751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:46 devstack sudo[83751]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:46 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:46 devstack cinder-volume[82640]: DEBUG cinder.manager [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Notifying Schedulers of capabilities ... {{(pid=82640) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:06:46 devstack cinder-volume[82640]: INFO cinder.volume.manager [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Driver initialization completed successfully. Jun 19 04:06:46 devstack cinder-volume[82640]: INFO cinder.manager [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Initiating service 2 cleanup Jun 19 04:06:46 devstack cinder-volume[82640]: INFO cinder.manager [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Service 2 cleanup completed. Jun 19 04:06:46 devstack cinder-volume[82640]: DEBUG cinder.service [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Creating RPC server for service cinder-volume {{(pid=82640) start /opt/stack/cinder/cinder/service.py:231}} Jun 19 04:06:46 devstack cinder-volume[82640]: DEBUG cinder.service [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82640) start /opt/stack/cinder/cinder/service.py:237}} Jun 19 04:06:46 devstack cinder-volume[82640]: INFO cinder.volume.manager [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 19 04:06:46 devstack cinder-volume[82640]: DEBUG cinder.volume.drivers.lvm [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Updating volume stats {{(pid=82640) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:06:46 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:46 devstack sudo[83755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:06:46 devstack sudo[83755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:47 devstack sudo[83755]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.692s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:47 devstack sudo[83758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:06:47 devstack sudo[83758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:47 devstack sudo[83758]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:47 devstack sudo[83779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:47 devstack sudo[83779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:48 devstack sudo[83779]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:48 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.654s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:48 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:48 devstack sudo[83821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:06:48 devstack sudo[83821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:49 devstack sudo[83821]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:49 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:49 devstack cinder-volume[82640]: INFO cinder.volume.manager [None req-b4a10e8b-7ad7-4891-9edb-b2cd72f2f504 None None] Driver post RPC initialization completed successfully. Jun 19 04:06:59 devstack cinder-volume[82640]: DEBUG dbcounter [-] [82640] Writing DB stats cinder:SELECT=3 {{(pid=82640) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:06:59 devstack cinder-volume[82640]: DEBUG dbcounter [-] [82640] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82640) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:07:47 devstack cinder-volume[82640]: DEBUG oslo_service.periodic_task [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82640) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:07:47 devstack cinder-volume[82640]: DEBUG cinder.volume.drivers.lvm [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Updating volume stats {{(pid=82640) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:07:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:07:47 devstack sudo[85527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:07:47 devstack sudo[85527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:07:47 devstack sudo[85527]: pam_unix(sudo:session): session closed for user root Jun 19 04:07:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:07:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:07:47 devstack sudo[85530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:07:47 devstack sudo[85530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:07:48 devstack sudo[85530]: pam_unix(sudo:session): session closed for user root Jun 19 04:07:48 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:07:48 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:07:48 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:07:48 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:07:49 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Jun 19 04:07:49 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.636s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:07:49 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:07:49 devstack sudo[85536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:07:49 devstack sudo[85536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:07:49 devstack sudo[85536]: pam_unix(sudo:session): session closed for user root Jun 19 04:07:49 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:07:49 devstack cinder-volume[82640]: DEBUG cinder.manager [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Notifying Schedulers of capabilities ... {{(pid=82640) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:07:49 devstack cinder-volume[82640]: DEBUG oslo_service.periodic_task [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running periodic task VolumeManager._thread_info {{(pid=82640) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:07:49 devstack cinder-volume[82640]: DEBUG cinder.volume.manager [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] thread count: 6 {{(pid=82640) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:07:49 devstack cinder-volume[82640]: DEBUG cinder.volume.manager [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] thread info: [<_MainThread(MainThread, started 133201086906496)>, , , , , ] {{(pid=82640) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:08:47 devstack cinder-volume[82640]: DEBUG oslo_service.periodic_task [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82640) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:08:47 devstack cinder-volume[82640]: DEBUG cinder.volume.drivers.lvm [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Updating volume stats {{(pid=82640) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:08:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:08:47 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:08:47 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:08:47 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Jun 19 04:08:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:08:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:08:47 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:08:47 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:08:48 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Jun 19 04:08:48 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:08:48 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:08:48 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:08:48 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:08:49 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Jun 19 04:08:49 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.610s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:08:49 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:08:49 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:08:49 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:08:49 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Jun 19 04:08:49 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:08:49 devstack cinder-volume[82640]: DEBUG cinder.manager [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Notifying Schedulers of capabilities ... {{(pid=82640) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:08:59 devstack cinder-volume[82640]: DEBUG dbcounter [-] [82640] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82640) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:09:47 devstack cinder-volume[82640]: DEBUG oslo_service.periodic_task [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82640) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:09:47 devstack cinder-volume[82640]: DEBUG cinder.volume.drivers.lvm [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Updating volume stats {{(pid=82640) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:09:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:09:47 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:09:47 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:09:47 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Jun 19 04:09:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:09:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:09:47 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:09:47 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:09:48 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Jun 19 04:09:48 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:09:48 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:09:48 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:09:48 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:09:49 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Jun 19 04:09:49 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.629s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:09:49 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:09:49 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:09:49 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:09:49 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Jun 19 04:09:49 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:09:49 devstack cinder-volume[82640]: DEBUG cinder.manager [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Notifying Schedulers of capabilities ... {{(pid=82640) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:09:49 devstack cinder-volume[82640]: DEBUG oslo_service.periodic_task [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running periodic task VolumeManager._thread_info {{(pid=82640) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:09:49 devstack cinder-volume[82640]: DEBUG cinder.volume.manager [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] thread count: 6 {{(pid=82640) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:09:49 devstack cinder-volume[82640]: DEBUG cinder.volume.manager [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] thread info: [<_MainThread(MainThread, started 133201086906496)>, , , , , ] {{(pid=82640) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:10:47 devstack cinder-volume[82640]: DEBUG oslo_service.periodic_task [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82640) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:10:47 devstack cinder-volume[82640]: DEBUG cinder.volume.drivers.lvm [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Updating volume stats {{(pid=82640) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:10:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:47 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:10:47 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:47 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:47 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:47 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:10:47 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:48 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:48 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:48 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:48 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:10:48 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:49 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:49 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:49 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:49 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:10:49 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:49 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:49 devstack cinder-volume[82640]: DEBUG oslo_concurrency.processutils [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=82640) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:49 devstack cinder-volume[82640]: DEBUG cinder.manager [None req-a6d2d2ce-f603-4301-a03c-78e78d73bcca None None] Notifying Schedulers of capabilities ... {{(pid=82640) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:10:59 devstack cinder-volume[82640]: DEBUG dbcounter [-] [82640] Writing DB stats cinder:SELECT=1 {{(pid=82640) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:10:59 devstack cinder-volume[82640]: DEBUG dbcounter [-] [82640] Writing DB stats cinder:UPDATE=1 {{(pid=82640) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:11:30 devstack cinder-volume[82476]: INFO oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Caught SIGTERM, stopping children Jun 19 04:11:30 devstack cinder-volume[82476]: DEBUG oslo_concurrency.lockutils [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Acquiring lock "singleton_lock" {{(pid=82476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:11:30 devstack cinder-volume[82476]: DEBUG oslo_concurrency.lockutils [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Acquired lock "singleton_lock" {{(pid=82476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:11:30 devstack cinder-volume[82476]: DEBUG oslo_concurrency.lockutils [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Releasing lock "singleton_lock" {{(pid=82476) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:11:30 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Stop services. {{(pid=82476) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 19 04:11:30 devstack cinder-volume[82476]: DEBUG oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Killing children. {{(pid=82476) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 19 04:11:30 devstack cinder-volume[82476]: INFO oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Waiting on 1 children to exit Jun 19 04:11:31 devstack cinder-volume[82640]: DEBUG oslo_concurrency.lockutils [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Acquiring lock "singleton_lock" {{(pid=82640) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:11:31 devstack cinder-volume[82640]: DEBUG oslo_concurrency.lockutils [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Acquired lock "singleton_lock" {{(pid=82640) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:11:31 devstack cinder-volume[82640]: DEBUG oslo_concurrency.lockutils [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Releasing lock "singleton_lock" {{(pid=82640) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:11:31 devstack cinder-volume[82640]: WARNING amqp [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 19 04:11:31 devstack cinder-volume[82640]: WARNING amqp [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 19 04:11:31 devstack cinder-volume[82476]: INFO oslo_service.backend._eventlet.service [None req-819ef36e-0d49-402c-844d-ab6416a718fd None None] Child 82640 exited with status 0 Jun 19 04:11:31 devstack cinder-volume[92735]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 19 04:11:31 devstack cinder-volume[92735]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:11:31 devstack cinder-volume[92735]: we strongly recommend against using it for new projects. Jun 19 04:11:31 devstack cinder-volume[92735]: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:11:31 devstack cinder-volume[92735]: framework. For more detail see Jun 19 04:11:31 devstack cinder-volume[92735]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:11:31 devstack cinder-volume[92735]: import eventlet # noqa Jun 19 04:11:33 devstack cinder-volume[92735]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92735) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:11:33 devstack cinder-volume[92735]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92735) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:11:33 devstack cinder-volume[92735]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92735) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:11:34 devstack cinder-volume[92735]: INFO dbcounter [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Registered counter for database cinder Jun 19 04:11:34 devstack cinder-volume[92735]: DEBUG oslo_db.sqlalchemy.engines [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92735) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG dbcounter [-] [92735] Writer thread running {{(pid=92735) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:11:35 devstack cinder-volume[92735]: INFO cinder.rpc [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 19 04:11:35 devstack cinder-volume[92735]: INFO cinder.rpc [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_db.sqlalchemy.engines [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92735) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:35 devstack cinder-volume[92735]: INFO cinder.volume.manager [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Determined volume DB was empty at startup. Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG cinder.volume.manager [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92735) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 19 04:11:35 devstack cinder-volume[92735]: INFO cinder.volume.manager [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 19 04:11:35 devstack cinder-volume[92735]: WARNING stevedore.named [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 04:11:35 devstack cinder-volume[92735]: WARNING castellan.key_manager [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:11:35 devstack cinder-volume[92735]: WARNING cinder.keymgr.conf_key_mgr [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:11:35 devstack cinder-volume[92735]: INFO cinder.volume.manager [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_db.sqlalchemy.engines [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92735) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:35 devstack cinder-volume[92735]: INFO oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Starting 1 workers Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Started child 92952 {{(pid=92735) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Full set of CONF: {{(pid=92735) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] ******************************************************************************** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Configuration options gathered from: {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] ================================================================================ {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] allow_availability_zone_fallback = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] allow_compression_on_image_upload = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] allowed_direct_url_schemes = [] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] api_rate_limit = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] auth_strategy = keystone {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_availability_zone = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_host = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_name = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_stats_polling_interval = 60 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backup_api_class = cinder.backup.api.API {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backup_name_template = backup-%s {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backup_use_same_host = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backup_use_temp_snapshot = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] chap_password = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] chap_username = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cinder_internal_tenant_project_id = aa121fff18fe4f409f8c799b357b5053 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cinder_internal_tenant_user_id = d5b58b6308dd4b418192207764d8a9c0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cluster = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] compression_format = gzip {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] compute_api_class = cinder.compute.nova.API {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] config_dir = [] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] config_source = [] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] control_exchange = openstack {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] debug = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] default_availability_zone = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] default_group_type = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] default_volume_type = QuobyteHD {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] disk_geometry = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] driver_client_cert = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] driver_client_cert_key = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] driver_data_namespace = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] driver_ssl_cert_path = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] driver_ssl_cert_verify = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] driver_use_ssl = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] enable_new_services = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] enable_unsupported_driver = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] enabled_backends = ['QuobyteHD'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] enforce_multipath_for_image_xfer = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] filter_function = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance_api_insecure = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance_api_servers = ['http://192.168.122.132/image'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance_api_ssl_compression = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance_ca_certificates_file = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance_catalog_info = image:glance:publicURL {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance_certfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance_keyfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance_num_retries = 3 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance_request_timeout = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] goodness_function = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] graceful_shutdown_timeout = 5 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] group_api_class = cinder.group.api.API {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] host = devstack {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] image_compress_on_upload = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] image_conversion_address_space_limit = 1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] image_conversion_cpu_limit = 60 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] image_conversion_disable = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] image_upload_use_cinder_backend = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92952]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] image_upload_use_internal_tenant = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] image_volume_cache_enabled = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] image_volume_cache_max_count = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] image_volume_cache_max_size_gb = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] init_host_max_objects_retrieval = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] instance_format = [instance: %(uuid)s] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] iscsi_target_flags = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] iscsi_write_cache = on {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] iser_helper = tgtadm {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] iser_ip_address = 192.168.122.132 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] iser_port = 3260 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] log_color = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] log_config_append = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] log_dir = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] log_file = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] log_options = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] log_rotate_interval = 1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] log_rotate_interval_type = days {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] log_rotation_type = none {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] max_age = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] max_logfile_count = 30 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] max_logfile_size_mb = 200 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] max_over_subscription_ratio = 20.0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] message_reap_interval = 86400 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] message_ttl = 2592000 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] migration_create_volume_timeout_secs = 300 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] monkey_patch = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] monkey_patch_modules = [] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] my_ip = 192.168.122.132 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] no_snapshot_gb_quota = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] num_iser_scan_tries = 3 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] num_shell_tries = 3 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] num_volume_device_scan_tries = 3 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] nvmeof_conn_info_version = 1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] nvmet_ns_id = 10 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] nvmet_port_id = 1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] osapi_max_limit = 1000 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] osapi_volume_ext_list = [] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] osapi_volume_listen_port = 8776 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] osapi_volume_use_ssl = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] osapi_volume_workers = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] per_volume_size_limit = -1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] periodic_fuzzy_delay = 60 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] periodic_interval = 60 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] public_endpoint = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] publish_errors = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] quota_backup_gigabytes = 1000 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] quota_backups = 10 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] quota_gigabytes = 1000 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] quota_groups = 10 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] quota_snapshots = 10 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] quota_volumes = 10 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] rate_limit_burst = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] rate_limit_except_level = CRITICAL {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] rate_limit_interval = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] reinit_driver_count = 3 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] replication_device = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] report_discard_supported = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] report_interval = 120 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] reservation_clean_interval = 86400 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] reservation_expire = 86400 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] reserved_image_namespaces = [] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] reserved_percentage = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] rpc_response_timeout = 120 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] run_external_periodic_tasks = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] scst_target_driver = iscsi {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] scst_target_iqn_name = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] service_down_time = 720 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] shell_completion = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] snapshot_name_template = snapshot-%s {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] split_loggers = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] state_path = /opt/stack/data/cinder {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] storage_availability_zone = nova {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] storage_protocol = iSCSI {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] syslog_log_facility = LOG_USER {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] target_helper = lioadm {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] target_ip_address = 192.168.122.132 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] target_port = 3260 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] target_protocol = iscsi {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] target_secondary_ip_addresses = [] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] trace_flags = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] transport_url = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] until_refresh = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] use_chap_auth = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] use_default_quota_class = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] use_journal = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] use_json = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] use_multipath_for_image_xfer = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] use_stderr = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] use_syslog = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] verify_glance_signatures = enabled {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] volume_api_class = cinder.volume.api.API {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] volume_backend_name = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] volume_clear = zero {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] volume_clear_ionice = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] volume_clear_size = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] volume_copy_bps_limit = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] volume_dd_blocksize = 1M {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] volume_name_template = volume-%s {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] volume_service_inithost_offload = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] volume_usage_audit_period = month {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] zoning_mode = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_concurrency.disable_process_locking = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.auth_section = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.auth_type = password {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.auth_version = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.cache = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.certfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.include_service_catalog = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.insecure = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.interface = public {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.keyfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_password = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92952]: INFO cinder.volume.manager [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Starting volume driver QuobyteDriver (1.1.14) Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92952]: DEBUG cinder.volume.drivers.remotefs [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92952) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcache_username = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.region_name = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.service_type = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.backend = dogpile.cache.null {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.backend_argument = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.backend_expiration_time = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.config_prefix = cache.oslo {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.debug_cache_backend = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.enable_retry_client = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.enable_socket_keepalive = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.enabled = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.expiration_time = 600 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.hashclient_retry_attempts = 2 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.memcache_dead_retry = 300 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.memcache_pool_maxsize = 10 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.memcache_sasl_enabled = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.password = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.proxies = [] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.redis_db = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.redis_server = localhost:6379 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.retry_attempts = 2 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.retry_delay = 0.0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.socket_keepalive_count = 1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.socket_keepalive_idle = 1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.socket_keepalive_interval = 1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.socket_timeout = 1.0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.tls_allowed_ciphers = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.tls_cafile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.tls_certfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.tls_enabled = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.tls_keyfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cache.username = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] coordination.backend_url = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.asyncio_connection = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.asyncio_slave_connection = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.backend = sqlalchemy {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.connection = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.connection_debug = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.connection_parameters = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.connection_recycle_time = 3600 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.connection_trace = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.db_inc_retry_interval = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.db_max_retries = 20 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.db_max_retry_interval = 10 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.db_retry_interval = 1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.max_overflow = 50 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.max_pool_size = 5 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.max_retries = 10 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.mysql_wsrep_sync_wait = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.pool_timeout = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.retry_interval = 10 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.slave_connection = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.sqlite_synchronous = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.synchronous_reader = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] database.use_db_reconnect = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] profiler.connection_string = messaging:// {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] profiler.enabled = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] profiler.es_doc_type = notification {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] profiler.es_scroll_size = 10000 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] profiler.es_scroll_time = 2m {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] profiler.filter_error_trace = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] profiler.hmac_keys = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] profiler.sentinel_service_name = mymaster {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] profiler.socket_timeout = 0.1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] profiler.trace_requests = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] profiler.trace_sqlalchemy = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] profiler_jaeger.process_tags = {} {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] profiler_jaeger.service_name_prefix = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] profiler_otlp.service_name_prefix = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_policy.enforce_new_defaults = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: WARNING oslo_config.cfg [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_policy.enforce_scope = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_policy.policy_default_rule = default {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_policy.policy_file = policy.yaml {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] privsep_osbrick.group = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] privsep_osbrick.helper_command = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] privsep_osbrick.user = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cinder_sys_admin.group = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cinder_sys_admin.helper_command = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] cinder_sys_admin.user = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] service_user.auth_section = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] service_user.auth_type = password {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] service_user.cafile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] service_user.certfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] service_user.collect_timing = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] service_user.insecure = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] service_user.keyfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] service_user.send_service_user_token = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] service_user.split_loggers = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] service_user.timeout = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance.auth_section = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance.auth_type = password {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance.certfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance.collect_timing = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance.insecure = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance.keyfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance.region_name = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance.split_loggers = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] glance.timeout = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.backend_availability_zone = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.chap_password = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.chap_username = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.disk_geometry = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.driver_client_cert = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.driver_client_cert_key = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.driver_data_namespace = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.driver_use_ssl = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.extra_capabilities = {} {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.filter_function = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.goodness_function = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.iscsi_target_flags = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.iscsi_write_cache = on {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.iser_helper = tgtadm {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.iser_port = 3260 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.nas_host = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.nas_login = admin {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.nas_mount_options = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.nas_password = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.nas_private_key = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.nas_share_path = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.num_shell_tries = 3 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.quobyte_volume_url = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.replication_device = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.report_discard_supported = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.reserved_percentage = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.target_helper = tgtadm {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.target_port = 3260 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.target_protocol = iscsi {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.trace_flags = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.unique_fqdn_network = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.use_chap_auth = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.volume_backend_name = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.volume_clear = zero {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.volume_clear_ionice = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.volume_clear_size = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_reports.file_event_handler = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_reports.log_dir = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.backend_availability_zone = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.backend_host = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.chap_password = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.chap_username = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.chiscsi_conf = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.disk_geometry = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.driver_client_cert = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.driver_data_namespace = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.driver_use_ssl = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.extra_capabilities = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.filter_function = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.goodness_function = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.iser_helper = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.iser_ip_address = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.iser_port = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.iser_target_prefix = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.nas_host = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.nas_login = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.nas_mount_options = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.nas_password = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.nas_private_key = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.nas_share_path = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.nas_ssh_port = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.num_shell_tries = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.nvmet_port_id = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.replication_device = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.report_discard_supported = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.reserved_percentage = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.scst_target_driver = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.storage_protocol = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.target_helper = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.target_ip_address = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.target_port = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.target_prefix = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.target_protocol = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.trace_flags = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92952]: DEBUG cinder.volume.drivers.quobyte [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92952) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.use_chap_auth = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.volume_clear = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.volume_clear_size = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] QuobyteHD.volumes_dir = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92952]: WARNING cinder.volume.drivers.quobyte [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 19 04:11:35 devstack cinder-volume[92952]: WARNING cinder.volume.drivers.quobyte [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92952]: DEBUG oslo_concurrency.processutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Running cmd (subprocess): mount.quobyte {{(pid=92952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.ssl = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_notifications.driver = [] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_notifications.retry = -1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] key_manager.fixed_key = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.barbican_api_version = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.barbican_endpoint = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.barbican_endpoint_type = public {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.barbican_region_name = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.cafile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.certfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.collect_timing = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.insecure = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.keyfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.number_of_retries = 60 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.retry_delay = 1 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.send_service_user_token = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.split_loggers = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.timeout = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.verify_ssl = True {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican.verify_ssl_path = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican_service_user.auth_section = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican_service_user.auth_type = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican_service_user.cafile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican_service_user.certfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican_service_user.collect_timing = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican_service_user.insecure = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican_service_user.keyfile = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican_service_user.split_loggers = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] barbican_service_user.timeout = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] vault.approle_role_id = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] vault.approle_secret_id = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] vault.kv_mountpoint = secret {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] vault.kv_path = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] vault.kv_version = 2 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] vault.namespace = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] vault.root_token_id = **** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] vault.ssl_ca_crt_file = None {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] vault.timeout = 60.0 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] vault.use_ssl = False {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:35 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] ******************************************************************************** {{(pid=92735) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 19 04:11:35 devstack quobyte-client[92957]: Reading configuration file: /etc/quobyte/client.cfg Jun 19 04:11:35 devstack quobyte-client[92957]: Invalid parameters found, error: missing mount point. Jun 19 04:11:35 devstack quobyte-client[92957]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 19 04:11:35 devstack quobyte-client[92957]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 19 04:11:35 devstack cinder-volume[92952]: DEBUG oslo_concurrency.processutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] CMD "mount.quobyte" returned: 1 in 0.094s {{(pid=92952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:35 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:11:35 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:11:35 devstack cinder-volume[92952]: DEBUG cinder.volume.drivers.quobyte [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=92952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:11:35 devstack cinder-volume[92952]: INFO cinder.volume.drivers.quobyte [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 ... Jun 19 04:11:35 devstack cinder-volume[92952]: DEBUG oslo_concurrency.processutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d -c /etc/quobyte/client-cinder.cfg {{(pid=92952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:35 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d -c /etc/quobyte/client-cinder.cfg Jun 19 04:11:35 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:36 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:36 devstack cinder-volume[92952]: DEBUG oslo_concurrency.processutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.839s {{(pid=92952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:36 devstack cinder-volume[92952]: INFO cinder.volume.drivers.quobyte [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 succeeded Jun 19 04:11:36 devstack cinder-volume[92952]: DEBUG cinder.volume.drivers.quobyte [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=92952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:11:36 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.850s {{(pid=92952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:11:36 devstack cinder-volume[92952]: DEBUG oslo_concurrency.processutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=92952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:36 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:11:36 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:37 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:37 devstack cinder-volume[92952]: DEBUG oslo_concurrency.processutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.693s {{(pid=92952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:37 devstack cinder-volume[92952]: INFO cinder.volume.driver [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Driver hasn't implemented _init_vendor_properties() Jun 19 04:11:37 devstack cinder-volume[92952]: DEBUG cinder.volume.driver [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578201293945, 'free_capacity_gb': 1775.7578201293945, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92952) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 19 04:11:37 devstack cinder-volume[92952]: DEBUG oslo_db.sqlalchemy.engines [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92952) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:37 devstack cinder-volume[92952]: DEBUG dbcounter [-] [92952] Writer thread running {{(pid=92952) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:11:37 devstack cinder-volume[92952]: DEBUG cinder.db.api [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Building query based on filter {{(pid=92952) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 19 04:11:37 devstack cinder-volume[92952]: DEBUG cinder.image.image_utils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92952) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 19 04:11:37 devstack cinder-volume[92952]: INFO cinder.keymgr.migration [None req-85da7079-e868-48f8-b0e0-5b8715d5adb1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 19 04:11:37 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:11:37 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:11:37 devstack cinder-volume[92952]: DEBUG cinder.volume.drivers.quobyte [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=92952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:11:37 devstack cinder-volume[92952]: DEBUG cinder.volume.drivers.quobyte [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=92952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:11:37 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:11:37 devstack cinder-volume[92952]: DEBUG oslo_concurrency.processutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=92952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:37 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:11:37 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:38 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:38 devstack cinder-volume[92952]: DEBUG oslo_concurrency.processutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.704s {{(pid=92952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:38 devstack cinder-volume[92952]: DEBUG cinder.manager [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Notifying Schedulers of capabilities ... {{(pid=92952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:11:38 devstack cinder-volume[92952]: INFO cinder.volume.manager [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Driver initialization completed successfully. Jun 19 04:11:38 devstack cinder-volume[92952]: INFO cinder.manager [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Initiating service 3 cleanup Jun 19 04:11:38 devstack cinder-volume[92952]: INFO cinder.manager [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Service 3 cleanup completed. Jun 19 04:11:38 devstack cinder-volume[92952]: DEBUG cinder.service [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Creating RPC server for service cinder-volume {{(pid=92952) start /opt/stack/cinder/cinder/service.py:231}} Jun 19 04:11:38 devstack cinder-volume[92952]: DEBUG cinder.service [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92952) start /opt/stack/cinder/cinder/service.py:237}} Jun 19 04:11:38 devstack cinder-volume[92952]: INFO cinder.volume.manager [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 19 04:11:38 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:11:38 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:11:38 devstack cinder-volume[92952]: DEBUG cinder.volume.drivers.quobyte [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=92952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:11:38 devstack cinder-volume[92952]: DEBUG cinder.volume.drivers.quobyte [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=92952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:11:38 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:11:38 devstack cinder-volume[92952]: DEBUG oslo_concurrency.processutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=92952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:38 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:11:38 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:39 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:39 devstack cinder-volume[92952]: DEBUG oslo_concurrency.processutils [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.918s {{(pid=92952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:39 devstack cinder-volume[92952]: INFO cinder.volume.manager [None req-3e13633b-8397-4d0c-a31a-cc173bb4e12c None None] Driver post RPC initialization completed successfully. Jun 19 04:11:43 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-4aa203a1-8d8b-4ed9-97d3-90ae3d2941b8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:11:43 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-4aa203a1-8d8b-4ed9-97d3-90ae3d2941b8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:11:43 devstack cinder-volume[92952]: DEBUG cinder.volume.drivers.quobyte [None req-4aa203a1-8d8b-4ed9-97d3-90ae3d2941b8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=92952) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:11:43 devstack cinder-volume[92952]: DEBUG cinder.volume.drivers.quobyte [None req-4aa203a1-8d8b-4ed9-97d3-90ae3d2941b8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=92952) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:11:43 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-4aa203a1-8d8b-4ed9-97d3-90ae3d2941b8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92952) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:11:43 devstack cinder-volume[92952]: DEBUG oslo_concurrency.processutils [None req-4aa203a1-8d8b-4ed9-97d3-90ae3d2941b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=92952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:43 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:11:43 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:43 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:43 devstack cinder-volume[92952]: DEBUG oslo_concurrency.processutils [None req-4aa203a1-8d8b-4ed9-97d3-90ae3d2941b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.583s {{(pid=92952) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:43 devstack cinder-volume[92952]: DEBUG cinder.manager [None req-4aa203a1-8d8b-4ed9-97d3-90ae3d2941b8 None None] Notifying Schedulers of capabilities ... {{(pid=92952) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:11:45 devstack cinder-volume[92735]: INFO oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Caught SIGTERM, stopping children Jun 19 04:11:45 devstack cinder-volume[92735]: DEBUG oslo_concurrency.lockutils [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Acquiring lock "singleton_lock" {{(pid=92735) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:11:45 devstack cinder-volume[92735]: DEBUG oslo_concurrency.lockutils [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Acquired lock "singleton_lock" {{(pid=92735) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:11:45 devstack cinder-volume[92735]: DEBUG oslo_concurrency.lockutils [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Releasing lock "singleton_lock" {{(pid=92735) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:11:45 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Stop services. {{(pid=92735) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 19 04:11:45 devstack cinder-volume[92735]: DEBUG oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Killing children. {{(pid=92735) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 19 04:11:45 devstack cinder-volume[92735]: INFO oslo_service.backend._eventlet.service [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Waiting on 1 children to exit Jun 19 04:11:49 devstack cinder-volume[92952]: DEBUG dbcounter [-] [92952] Writing DB stats cinder:SELECT=4 {{(pid=92952) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:11:49 devstack cinder-volume[92952]: DEBUG dbcounter [-] [92952] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=92952) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:11:50 devstack cinder-volume[92952]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 19 04:11:50 devstack cinder-volume[93245]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 19 04:11:50 devstack cinder-volume[93245]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:11:50 devstack cinder-volume[93245]: we strongly recommend against using it for new projects. Jun 19 04:11:50 devstack cinder-volume[93245]: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:11:50 devstack cinder-volume[93245]: framework. For more detail see Jun 19 04:11:50 devstack cinder-volume[93245]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:11:50 devstack cinder-volume[93245]: import eventlet # noqa Jun 19 04:11:51 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Acquiring lock "singleton_lock" {{(pid=92952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:11:51 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Acquired lock "singleton_lock" {{(pid=92952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:11:51 devstack cinder-volume[92952]: DEBUG oslo_concurrency.lockutils [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Releasing lock "singleton_lock" {{(pid=92952) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:11:51 devstack cinder-volume[92952]: WARNING amqp [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 19 04:11:51 devstack cinder-volume[92952]: WARNING amqp [None req-afd8eaf9-4f63-48ee-be95-f49d97544075 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 19 04:11:53 devstack cinder-volume[93245]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:11:53 devstack cinder-volume[93245]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:11:53 devstack cinder-volume[93245]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93245) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:11:53 devstack cinder-volume[93245]: INFO dbcounter [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] Registered counter for database cinder Jun 19 04:11:53 devstack cinder-volume[93245]: DEBUG oslo_db.sqlalchemy.engines [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG dbcounter [-] [93245] Writer thread running {{(pid=93245) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:11:54 devstack cinder-volume[93245]: INFO cinder.rpc [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 19 04:11:54 devstack cinder-volume[93245]: INFO cinder.rpc [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_db.sqlalchemy.engines [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:54 devstack cinder-volume[93245]: INFO cinder.volume.manager [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] Determined volume DB was empty at startup. Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG cinder.volume.manager [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93245) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 19 04:11:54 devstack cinder-volume[93245]: WARNING stevedore.named [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 04:11:54 devstack cinder-volume[93245]: WARNING castellan.key_manager [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:11:54 devstack cinder-volume[93245]: WARNING cinder.keymgr.conf_key_mgr [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:11:54 devstack cinder-volume[93245]: INFO cinder.volume.manager [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_db.sqlalchemy.engines [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93245) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:54 devstack cinder-volume[93245]: INFO oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] Starting 1 workers Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] Started child 93530 {{(pid=93245) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] Full set of CONF: {{(pid=93245) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] ******************************************************************************** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] Configuration options gathered from: {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] ================================================================================ {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] allow_availability_zone_fallback = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] allow_compression_on_image_upload = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] allowed_direct_url_schemes = [] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] api_rate_limit = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] auth_strategy = keystone {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_availability_zone = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_host = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_name = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_stats_polling_interval = 60 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backup_api_class = cinder.backup.api.API {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93530]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backup_name_template = backup-%s {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backup_use_same_host = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backup_use_temp_snapshot = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] chap_password = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] chap_username = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cinder_internal_tenant_project_id = aa121fff18fe4f409f8c799b357b5053 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cinder_internal_tenant_user_id = d5b58b6308dd4b418192207764d8a9c0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cluster = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] compression_format = gzip {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] compute_api_class = cinder.compute.nova.API {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] config_dir = [] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] config_source = [] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] control_exchange = openstack {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] debug = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] default_availability_zone = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] default_group_type = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] default_volume_type = QuobyteHD {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] disk_geometry = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] driver_client_cert = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] driver_client_cert_key = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] driver_data_namespace = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] driver_ssl_cert_path = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] driver_ssl_cert_verify = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] driver_use_ssl = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] enable_new_services = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] enable_unsupported_driver = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] enabled_backends = ['QuobyteHD'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] enforce_multipath_for_image_xfer = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] filter_function = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance_api_insecure = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance_api_servers = ['http://192.168.122.132/image'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance_api_ssl_compression = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance_ca_certificates_file = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance_catalog_info = image:glance:publicURL {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance_certfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance_keyfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance_num_retries = 3 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance_request_timeout = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] goodness_function = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] graceful_shutdown_timeout = 5 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] group_api_class = cinder.group.api.API {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] host = devstack {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] image_compress_on_upload = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] image_conversion_address_space_limit = 1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] image_conversion_cpu_limit = 60 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] image_conversion_disable = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] image_upload_use_cinder_backend = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] image_upload_use_internal_tenant = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] image_volume_cache_enabled = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] image_volume_cache_max_count = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] image_volume_cache_max_size_gb = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] init_host_max_objects_retrieval = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] instance_format = [instance: %(uuid)s] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] iscsi_target_flags = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] iscsi_write_cache = on {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] iser_helper = tgtadm {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] iser_ip_address = 192.168.122.132 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] iser_port = 3260 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] log_color = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] log_config_append = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] log_dir = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] log_file = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] log_options = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] log_rotate_interval = 1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] log_rotate_interval_type = days {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] log_rotation_type = none {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] max_age = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] max_logfile_count = 30 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] max_logfile_size_mb = 200 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] max_over_subscription_ratio = 20.0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] message_reap_interval = 86400 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] message_ttl = 2592000 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] migration_create_volume_timeout_secs = 300 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] monkey_patch = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] monkey_patch_modules = [] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] my_ip = 192.168.122.132 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] no_snapshot_gb_quota = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] num_iser_scan_tries = 3 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] num_shell_tries = 3 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] num_volume_device_scan_tries = 3 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] nvmeof_conn_info_version = 1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] nvmet_ns_id = 10 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] nvmet_port_id = 1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] osapi_max_limit = 1000 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] osapi_volume_ext_list = [] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] osapi_volume_listen_port = 8776 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] osapi_volume_use_ssl = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] osapi_volume_workers = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] per_volume_size_limit = -1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] periodic_fuzzy_delay = 60 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] periodic_interval = 60 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] public_endpoint = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] publish_errors = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] quota_backup_gigabytes = 1000 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] quota_backups = 10 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] quota_gigabytes = 1000 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] quota_groups = 10 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] quota_snapshots = 10 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] quota_volumes = 10 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] rate_limit_burst = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] rate_limit_except_level = CRITICAL {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] rate_limit_interval = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] reinit_driver_count = 3 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] replication_device = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] report_discard_supported = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] report_interval = 120 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Starting volume driver QuobyteDriver (1.1.14) Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] reservation_clean_interval = 86400 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] reservation_expire = 86400 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] reserved_image_namespaces = [] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] reserved_percentage = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] rpc_response_timeout = 120 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] run_external_periodic_tasks = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] scst_target_driver = iscsi {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] scst_target_iqn_name = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] service_down_time = 720 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] shell_completion = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] snapshot_name_template = snapshot-%s {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] split_loggers = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93530) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] state_path = /opt/stack/data/cinder {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] storage_availability_zone = nova {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] storage_protocol = iSCSI {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] syslog_log_facility = LOG_USER {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] target_helper = lioadm {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] target_ip_address = 192.168.122.132 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] target_port = 3260 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] target_protocol = iscsi {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] target_secondary_ip_addresses = [] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] trace_flags = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] transport_url = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] until_refresh = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] use_chap_auth = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] use_default_quota_class = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] use_journal = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] use_json = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] use_multipath_for_image_xfer = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] use_stderr = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] use_syslog = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] verify_glance_signatures = enabled {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] volume_api_class = cinder.volume.api.API {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] volume_backend_name = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] volume_clear = zero {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] volume_clear_ionice = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] volume_clear_size = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] volume_copy_bps_limit = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] volume_dd_blocksize = 1M {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] volume_name_template = volume-%s {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] volume_service_inithost_offload = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] volume_usage_audit_period = month {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] zoning_mode = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_concurrency.disable_process_locking = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.auth_section = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.auth_type = password {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.auth_version = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.cache = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.certfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.include_service_catalog = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.insecure = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.interface = public {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.keyfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_password = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcache_username = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.region_name = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.service_type = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.132/identity {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.backend = dogpile.cache.null {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.backend_argument = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.backend_expiration_time = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.config_prefix = cache.oslo {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.debug_cache_backend = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.enable_retry_client = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.enable_socket_keepalive = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.enabled = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.expiration_time = 600 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.hashclient_retry_attempts = 2 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.memcache_dead_retry = 300 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.memcache_pool_maxsize = 10 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.memcache_sasl_enabled = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.password = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.proxies = [] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.redis_db = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.redis_server = localhost:6379 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.retry_attempts = 2 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.retry_delay = 0.0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.socket_keepalive_count = 1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.socket_keepalive_idle = 1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.socket_keepalive_interval = 1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.socket_timeout = 1.0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.tls_allowed_ciphers = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.tls_cafile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.tls_certfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.tls_enabled = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.tls_keyfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cache.username = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] coordination.backend_url = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.asyncio_connection = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.asyncio_slave_connection = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.backend = sqlalchemy {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.connection = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.connection_debug = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.connection_parameters = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.connection_recycle_time = 3600 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.connection_trace = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.db_inc_retry_interval = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.db_max_retries = 20 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.db_max_retry_interval = 10 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.db_retry_interval = 1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.max_overflow = 50 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.max_pool_size = 5 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.max_retries = 10 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.mysql_wsrep_sync_wait = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.pool_timeout = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.retry_interval = 10 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.slave_connection = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.sqlite_synchronous = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.synchronous_reader = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] database.use_db_reconnect = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] profiler.connection_string = messaging:// {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] profiler.enabled = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] profiler.es_doc_type = notification {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] profiler.es_scroll_size = 10000 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] profiler.es_scroll_time = 2m {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] profiler.filter_error_trace = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] profiler.hmac_keys = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] profiler.sentinel_service_name = mymaster {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] profiler.socket_timeout = 0.1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] profiler.trace_requests = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] profiler.trace_sqlalchemy = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] profiler_jaeger.process_tags = {} {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] profiler_jaeger.service_name_prefix = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] profiler_otlp.service_name_prefix = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_policy.enforce_new_defaults = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: WARNING oslo_config.cfg [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_policy.enforce_scope = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_policy.policy_default_rule = default {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_policy.policy_file = policy.yaml {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] privsep_osbrick.group = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] privsep_osbrick.helper_command = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] privsep_osbrick.user = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cinder_sys_admin.group = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cinder_sys_admin.helper_command = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] cinder_sys_admin.user = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] service_user.auth_section = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] service_user.auth_type = password {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] service_user.cafile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] service_user.certfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] service_user.collect_timing = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] service_user.insecure = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] service_user.keyfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] service_user.send_service_user_token = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] service_user.split_loggers = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] service_user.timeout = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance.auth_section = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance.auth_type = password {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance.certfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance.collect_timing = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance.insecure = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance.keyfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance.region_name = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance.split_loggers = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] glance.timeout = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.backend_availability_zone = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.chap_password = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93530) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 19 04:11:54 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.quobyte [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 19 04:11:54 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.quobyte [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.chap_username = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.disk_geometry = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.driver_client_cert = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Running cmd (subprocess): mount.quobyte {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.driver_client_cert_key = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.driver_data_namespace = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.driver_use_ssl = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.extra_capabilities = {} {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.filter_function = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.goodness_function = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.iscsi_target_flags = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.iscsi_write_cache = on {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.iser_helper = tgtadm {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.iser_ip_address = 192.168.122.132 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.iser_port = 3260 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.nas_host = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.nas_login = admin {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.nas_mount_options = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.nas_password = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.nas_private_key = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.nas_share_path = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.num_shell_tries = 3 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.quobyte_volume_url = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.replication_device = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.report_discard_supported = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.reserved_percentage = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.target_helper = tgtadm {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.target_ip_address = 192.168.122.132 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.target_port = 3260 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.target_protocol = iscsi {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.trace_flags = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.unique_fqdn_network = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.use_chap_auth = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.volume_backend_name = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.volume_clear = zero {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.volume_clear_ionice = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.volume_clear_size = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_reports.file_event_handler = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_reports.log_dir = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.backend_availability_zone = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.backend_host = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.chap_password = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.chap_username = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.chiscsi_conf = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.disk_geometry = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.driver_client_cert = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.driver_data_namespace = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.driver_use_ssl = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.extra_capabilities = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.filter_function = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.goodness_function = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.iser_helper = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.iser_ip_address = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.iser_port = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.iser_target_prefix = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.nas_host = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.nas_login = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.nas_mount_options = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.nas_password = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.nas_private_key = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.nas_share_path = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.nas_ssh_port = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.num_shell_tries = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.nvmet_port_id = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.replication_device = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.report_discard_supported = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.reserved_percentage = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.scst_target_driver = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.storage_protocol = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.target_helper = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.target_ip_address = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.target_port = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.target_prefix = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.target_protocol = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.trace_flags = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.use_chap_auth = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.volume_clear = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.volume_clear_size = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] QuobyteHD.volumes_dir = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.ssl = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_notifications.driver = [] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_notifications.retry = -1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] key_manager.fixed_key = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.barbican_api_version = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack quobyte-client[93536]: Reading configuration file: /etc/quobyte/client.cfg Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.barbican_endpoint = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.barbican_endpoint_type = public {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.barbican_region_name = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack quobyte-client[93536]: Invalid parameters found, error: missing mount point. Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.cafile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.certfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.collect_timing = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.insecure = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.keyfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack quobyte-client[93536]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.number_of_retries = 60 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.retry_delay = 1 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.send_service_user_token = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.split_loggers = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.timeout = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack quobyte-client[93536]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.verify_ssl = True {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican.verify_ssl_path = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican_service_user.auth_section = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican_service_user.auth_type = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican_service_user.cafile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican_service_user.certfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican_service_user.collect_timing = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican_service_user.insecure = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican_service_user.keyfile = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican_service_user.split_loggers = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] barbican_service_user.timeout = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] vault.approle_role_id = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] vault.approle_secret_id = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] vault.kv_mountpoint = secret {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] vault.kv_path = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] vault.kv_version = 2 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] vault.namespace = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] vault.root_token_id = **** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] vault.ssl_ca_crt_file = None {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] vault.timeout = 60.0 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] vault.use_ssl = False {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:54 devstack cinder-volume[93245]: DEBUG oslo_service.backend._eventlet.service [None req-bcbda81a-b202-4f48-a962-2e43c1b7ec32 None None] ******************************************************************************** {{(pid=93245) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 19 04:11:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:11:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:11:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:54 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:11:54 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:55 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.633s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:55 devstack cinder-volume[93530]: INFO cinder.volume.driver [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Driver hasn't implemented _init_vendor_properties() Jun 19 04:11:55 devstack cinder-volume[93530]: DEBUG cinder.volume.driver [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578201293945, 'free_capacity_gb': 1775.7578201293945, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93530) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 19 04:11:55 devstack cinder-volume[93530]: DEBUG oslo_db.sqlalchemy.engines [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93530) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:55 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writer thread running {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:11:55 devstack cinder-volume[93530]: DEBUG cinder.db.api [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Building query based on filter {{(pid=93530) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 19 04:11:55 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93530) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 19 04:11:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:11:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:11:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:11:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:11:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:11:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:55 devstack cinder-volume[93530]: INFO cinder.keymgr.migration [None req-b6cb2cff-eb85-44e5-b357-8c35eacb6747 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 19 04:11:55 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:11:55 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:56 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.641s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:56 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:11:56 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Driver initialization completed successfully. Jun 19 04:11:56 devstack cinder-volume[93530]: INFO cinder.manager [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Initiating service 3 cleanup Jun 19 04:11:56 devstack cinder-volume[93530]: INFO cinder.manager [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Service 3 cleanup completed. Jun 19 04:11:56 devstack cinder-volume[93530]: DEBUG cinder.service [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Creating RPC server for service cinder-volume {{(pid=93530) start /opt/stack/cinder/cinder/service.py:231}} Jun 19 04:11:56 devstack cinder-volume[93530]: DEBUG cinder.service [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93530) start /opt/stack/cinder/cinder/service.py:237}} Jun 19 04:11:56 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 19 04:11:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:11:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:11:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:11:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:11:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:11:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:56 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:11:56 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:56 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.623s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:56 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-c3f3c8af-6af2-4cb2-8e60-87c18b985d6a None None] Driver post RPC initialization completed successfully. Jun 19 04:11:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:11:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 6 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:11:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:12:04 devstack cinder-volume[93245]: DEBUG dbcounter [-] [93245] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93245) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:12:05 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=2 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:12:06 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Flow 'volume_create_manager' (30547950-2dd9-421d-8441-67844f8a7cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e864766-2188-4153-870c-37bab825efc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e864766-2188-4153-870c-37bab825efc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1605220098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf39cae-0b10-4b63-a260-18756d68bdda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c3d0d51759b42e69b922f14aaa2ce3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:12:52Z,use_quota=True,user_id='c6e4ccd264c14041876fa7dcb3b87d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196095fc-cce8-4be9-9035-e6bad070843e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (196095fc-cce8-4be9-9035-e6bad070843e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dd1f6e-1650-4adf-84cb-7e22d22da0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dd1f6e-1650-4adf-84cb-7e22d22da0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bf39cae-0b10-4b63-a260-18756d68bdda', 'volume_name': 'volume-9bf39cae-0b10-4b63-a260-18756d68bdda', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdc788a-70ac-474e-a6fc-9dfd66c9da24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdc788a-70ac-474e-a6fc-9dfd66c9da24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03dfd16-3427-4c52-9c80-50ddad07e798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:52 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Volume 9bf39cae-0b10-4b63-a260-18756d68bdda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bf39cae-0b10-4b63-a260-18756d68bdda', 'volume_size': 1} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1605220098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf39cae-0b10-4b63-a260-18756d68bdda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c3d0d51759b42e69b922f14aaa2ce3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:12:52Z,use_quota=True,user_id='c6e4ccd264c14041876fa7dcb3b87d31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Creating volume 9bf39cae-0b10-4b63-a260-18756d68bdda {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:12:52 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:12:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:52 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda 1073741824 Jun 19 04:12:52 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:53 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda 1073741824" returned: 0 in 1.204s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:54 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda Jun 19 04:12:54 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:54 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda" returned: 0 in 0.809s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:12:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f03dfd16-3427-4c52-9c80-50ddad07e798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf39cae-0b10-4b63-a260-18756d68bdda', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5863ad25-f91c-4cd8-a3b8-70a3fc775c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:54 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Volume volume-9bf39cae-0b10-4b63-a260-18756d68bdda (9bf39cae-0b10-4b63-a260-18756d68bdda): created successfully Jun 19 04:12:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5863ad25-f91c-4cd8-a3b8-70a3fc775c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Flow 'volume_create_manager' (30547950-2dd9-421d-8441-67844f8a7cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:12:54 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-decde7fd-1bc2-404c-ad31-65f27ff67874 tempest-TaggedAttachmentsTest-449671219 None] Created volume successfully. Jun 19 04:12:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:12:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:12:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:12:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:58 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:12:58 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:59 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.690s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:12:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:12:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 6 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:12:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:13:04 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:13:04 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Flow 'volume_create_manager' (965dfbc2-9642-4c20-9736-f3301006af69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b512a4ab-79f0-4dc4-8794-6293d80fbc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b512a4ab-79f0-4dc4-8794-6293d80fbc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-599370729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4cb741-00a1-44dd-b411-e074b299848e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5184d91d8442f0af6b54b7912c866b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:09Z,use_quota=True,user_id='37420b5addd746269d632c2e09688c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc848a81-4295-4747-bf39-8c349da84d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc848a81-4295-4747-bf39-8c349da84d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0333d5eb-dc15-4edd-ab7e-c1dc53af1ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0333d5eb-dc15-4edd-ab7e-c1dc53af1ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b4cb741-00a1-44dd-b411-e074b299848e', 'volume_name': 'volume-9b4cb741-00a1-44dd-b411-e074b299848e', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc714b44-666d-4a55-8b7c-c864706c3330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc714b44-666d-4a55-8b7c-c864706c3330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e151d5fe-9d0a-481c-a53c-f4f1f91b194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:09 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Volume 9b4cb741-00a1-44dd-b411-e074b299848e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b4cb741-00a1-44dd-b411-e074b299848e', 'volume_size': 1} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-599370729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4cb741-00a1-44dd-b411-e074b299848e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac5184d91d8442f0af6b54b7912c866b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:09Z,use_quota=True,user_id='37420b5addd746269d632c2e09688c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Creating volume 9b4cb741-00a1-44dd-b411-e074b299848e {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:13:09 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:13:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:09 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e 1073741824 Jun 19 04:13:09 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:11 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e 1073741824" returned: 0 in 2.579s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:12 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e Jun 19 04:13:12 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:13 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e" returned: 0 in 1.376s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] <== create_volume: return (4091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:13:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.093s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e151d5fe-9d0a-481c-a53c-f4f1f91b194f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4cb741-00a1-44dd-b411-e074b299848e', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf2370e-90f8-4bfa-9ae9-00166f722764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:13 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Volume volume-9b4cb741-00a1-44dd-b411-e074b299848e (9b4cb741-00a1-44dd-b411-e074b299848e): created successfully Jun 19 04:13:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf2370e-90f8-4bfa-9ae9-00166f722764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Flow 'volume_create_manager' (965dfbc2-9642-4c20-9736-f3301006af69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:13 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-dd7de6ed-ae3f-4665-bdef-4d9fbdca4e2a tempest-DeleteServersTestJSON-1662150711 None] Created volume successfully. Jun 19 04:13:23 devstack cinder-volume[93530]: WARNING py.warnings [req-62e502e3-48e9-40b4-bce9-f9fd208e82fc req-8da6d2f9-6f42-498c-a4b0-34a6f5c79272 tempest-DeleteServersTestJSON-1662150711 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jun 19 04:13:23 devstack cinder-volume[93530]: .first() Jun 19 04:13:23 devstack cinder-volume[93530]: Jun 19 04:13:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-62e502e3-48e9-40b4-bce9-f9fd208e82fc req-8da6d2f9-6f42-498c-a4b0-34a6f5c79272 tempest-DeleteServersTestJSON-1662150711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-62e502e3-48e9-40b4-bce9-f9fd208e82fc req-8da6d2f9-6f42-498c-a4b0-34a6f5c79272 tempest-DeleteServersTestJSON-1662150711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:23 devstack cinder-volume[93530]: INFO oslo.privsep.daemon [req-62e502e3-48e9-40b4-bce9-f9fd208e82fc req-8da6d2f9-6f42-498c-a4b0-34a6f5c79272 tempest-DeleteServersTestJSON-1662150711 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxnw9vj1x/privsep.sock'] Jun 19 04:13:23 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxnw9vj1x/privsep.sock Jun 19 04:13:23 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:23 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:13:24 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 19 04:13:24 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:13:24 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 19 04:13:24 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 04:13:24 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:13:24 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 19 04:13:24 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:13:24 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 04:13:24 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 19 04:13:25 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 19 04:13:25 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:13:25 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 19 04:13:25 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 04:13:25 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:13:25 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 19 04:13:25 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:13:25 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 04:13:25 devstack cinder-volume[93530]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 19 04:13:25 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:25 devstack cinder-volume[93530]: INFO oslo.privsep.daemon [req-62e502e3-48e9-40b4-bce9-f9fd208e82fc req-8da6d2f9-6f42-498c-a4b0-34a6f5c79272 tempest-DeleteServersTestJSON-1662150711 None] Spawned new privsep daemon via rootwrap Jun 19 04:13:25 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [req-62e502e3-48e9-40b4-bce9-f9fd208e82fc req-8da6d2f9-6f42-498c-a4b0-34a6f5c79272 tempest-DeleteServersTestJSON-1662150711 None] Accepted privsep connection to /tmp/tmpxnw9vj1x/privsep.sock {{(pid=93530) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 19 04:13:25 devstack cinder-volume[93530]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 19 04:13:25 devstack cinder-volume[93530]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 19 04:13:25 devstack cinder-volume[93530]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 19 04:13:25 devstack cinder-volume[93530]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94727 Jun 19 04:13:25 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac483f7-8808-434d-9e39-0042d16dd3e6]: (2,) {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:13:25 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[723eab1d-8767-4002-ae97-3ab8fc5cc48e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:13:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-62e502e3-48e9-40b4-bce9-f9fd208e82fc req-8da6d2f9-6f42-498c-a4b0-34a6f5c79272 tempest-DeleteServersTestJSON-1662150711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:25 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e Jun 19 04:13:25 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:26 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-62e502e3-48e9-40b4-bce9-f9fd208e82fc req-8da6d2f9-6f42-498c-a4b0-34a6f5c79272 tempest-DeleteServersTestJSON-1662150711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e" returned: 0 in 0.926s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-62e502e3-48e9-40b4-bce9-f9fd208e82fc req-8da6d2f9-6f42-498c-a4b0-34a6f5c79272 tempest-DeleteServersTestJSON-1662150711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-62e502e3-48e9-40b4-bce9-f9fd208e82fc req-8da6d2f9-6f42-498c-a4b0-34a6f5c79272 tempest-DeleteServersTestJSON-1662150711 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-9b4cb741-00a1-44dd-b411-e074b299848e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '959253ac-aa04-4596-a536-2c6b3ac5a38c', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:13:26 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-62e502e3-48e9-40b4-bce9-f9fd208e82fc req-8da6d2f9-6f42-498c-a4b0-34a6f5c79272 tempest-DeleteServersTestJSON-1662150711 None] attachment_update completed successfully. Jun 19 04:13:36 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=5,cinder:SELECT=7,cinder:DELETE=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:13:36 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:13:39 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-84a38030-8782-4dbf-b5b9-f77a7c8fa425 req-ae98633a-ad8d-4a80-9ad5-adaac7805d12 tempest-DeleteServersTestJSON-1662150711 None] Terminate volume connection completed successfully. Jun 19 04:13:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-84a38030-8782-4dbf-b5b9-f77a7c8fa425 req-ae98633a-ad8d-4a80-9ad5-adaac7805d12 tempest-DeleteServersTestJSON-1662150711 None] Deleting attachment 959253ac-aa04-4596-a536-2c6b3ac5a38c. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:13:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Acquiring lock "cinder-9b4cb741-00a1-44dd-b411-e074b299848e-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:13:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Lock "cinder-9b4cb741-00a1-44dd-b411-e074b299848e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:13:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Acquiring lock "cinder-quobyte-9b4cb741-00a1-44dd-b411-e074b299848e" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:13:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Lock "cinder-quobyte-9b4cb741-00a1-44dd-b411-e074b299848e" acquired by "delete_volume" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:13:43 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a21705-2402-4e8f-9704-1df2b3f29c4a]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:13:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:43 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e Jun 19 04:13:43 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:44 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e" returned: 0 in 0.867s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:44 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e Jun 19 04:13:44 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:45 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9b4cb741-00a1-44dd-b411-e074b299848e" returned: 0 in 1.131s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Lock "cinder-quobyte-9b4cb741-00a1-44dd-b411-e074b299848e" released by "delete_volume" :: held 2.054s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Flow 'volume_create_manager' (3abfd2d2-ee1b-4522-8336-3732851d260c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c94779-52ff-4339-9214-b72cbf780f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32c94779-52ff-4339-9214-b72cbf780f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1174692926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecf100f-6d13-49cb-b2dd-f31cecdc2c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2534049b5a564f60bb9de084ac4fafab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:46Z,use_quota=True,user_id='ea5f564381494c49a6273a9ab7ac5943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03def69-ddbd-428f-bc0a-fa8c0da2cbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03def69-ddbd-428f-bc0a-fa8c0da2cbee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67afcd3d-747b-4d24-9dd3-db7d37d107f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67afcd3d-747b-4d24-9dd3-db7d37d107f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ecf100f-6d13-49cb-b2dd-f31cecdc2c39', 'volume_name': 'volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1900bc07-0787-4c5e-ac7d-4c58e01375ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1900bc07-0787-4c5e-ac7d-4c58e01375ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bc8618-9867-4301-828f-cf958201db77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:45 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Volume 1ecf100f-6d13-49cb-b2dd-f31cecdc2c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39', 'volume_size': 1} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1174692926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecf100f-6d13-49cb-b2dd-f31cecdc2c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2534049b5a564f60bb9de084ac4fafab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:46Z,use_quota=True,user_id='ea5f564381494c49a6273a9ab7ac5943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Creating volume 1ecf100f-6d13-49cb-b2dd-f31cecdc2c39 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:13:45 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:13:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:46 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39 1073741824 Jun 19 04:13:46 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:46 devstack cinder-volume[93530]: WARNING cinder.quota [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:13:46 devstack cinder-volume[93530]: WARNING cinder.quota [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:13:46 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Created reservations ['1d77e77a-56dc-49bf-b656-3775ed442716', '10f1eea5-f1c5-4215-b1c8-af0f22452636', '76def6a7-e9e0-4248-bcab-ce6a4c65ab6b', '0f3390f3-ff57-4594-8367-097e97d9c46c'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:13:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:46 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:13:46 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:47 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.940s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:47 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:13:47 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Deleted volume successfully. Jun 19 04:13:47 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a8e351cc-7795-48d5-9e25-42c105128508 tempest-DeleteServersTestJSON-1662150711 None] Lock "cinder-9b4cb741-00a1-44dd-b411-e074b299848e-delete_volume" released by "delete_volume" :: held 3.533s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:13:47 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39 1073741824" returned: 0 in 1.263s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:47 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39 Jun 19 04:13:47 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:47 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39" returned: 0 in 0.718s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:13:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.032s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bc8618-9867-4301-828f-cf958201db77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b703c685-f51f-4b2a-bdcd-35a08d9b79d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:48 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Volume volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39 (1ecf100f-6d13-49cb-b2dd-f31cecdc2c39): created successfully Jun 19 04:13:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b703c685-f51f-4b2a-bdcd-35a08d9b79d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Flow 'volume_create_manager' (3abfd2d2-ee1b-4522-8336-3732851d260c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:48 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-749090a4-c684-46c3-888f-44f717267bca tempest-ServersNegativeTestJSON-1446247129 None] Created volume successfully. Jun 19 04:13:50 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:13:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Flow 'volume_create_manager' (e69721cb-5a9a-4ef9-947e-02b9724368e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1959fab2-4b5e-45e9-89f3-6442a2530a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1959fab2-4b5e-45e9-89f3-6442a2530a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1063081723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f9681c-4c5b-4cd6-a8a2-41f5935f540b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2534049b5a564f60bb9de084ac4fafab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:51Z,use_quota=True,user_id='ea5f564381494c49a6273a9ab7ac5943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb5deb5-b451-4645-9642-aabd6482282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb5deb5-b451-4645-9642-aabd6482282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed09c9b-91a6-47b6-8cdb-28c8ee499838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed09c9b-91a6-47b6-8cdb-28c8ee499838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4f9681c-4c5b-4cd6-a8a2-41f5935f540b', 'volume_name': 'volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5193c9-8874-4480-bec5-51eed2c953b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5193c9-8874-4480-bec5-51eed2c953b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4df440-9d8f-4751-84fb-5df82a87c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:51 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Volume a4f9681c-4c5b-4cd6-a8a2-41f5935f540b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b', 'volume_size': 1} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1063081723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4f9681c-4c5b-4cd6-a8a2-41f5935f540b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2534049b5a564f60bb9de084ac4fafab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:51Z,use_quota=True,user_id='ea5f564381494c49a6273a9ab7ac5943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Creating volume a4f9681c-4c5b-4cd6-a8a2-41f5935f540b {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:13:51 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:13:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:51 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b 1073741824 Jun 19 04:13:51 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:52 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b 1073741824" returned: 0 in 1.161s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:52 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b Jun 19 04:13:52 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:52 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b" returned: 0 in 0.688s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:13:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4df440-9d8f-4751-84fb-5df82a87c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35abc164-2d92-42f1-8d37-8fcf1639c88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:52 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Volume volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b (a4f9681c-4c5b-4cd6-a8a2-41f5935f540b): created successfully Jun 19 04:13:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35abc164-2d92-42f1-8d37-8fcf1639c88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Flow 'volume_create_manager' (e69721cb-5a9a-4ef9-947e-02b9724368e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:53 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-33f2e044-fa73-426d-ad84-c4dcc500fec6 tempest-ServersNegativeTestJSON-1446247129 None] Created volume successfully. Jun 19 04:13:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Acquiring lock "cinder-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:13:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Lock "cinder-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:13:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Acquiring lock "cinder-quobyte-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:13:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Lock "cinder-quobyte-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b" acquired by "delete_volume" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:13:56 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f33968-7077-434d-b1f3-15d4930946ae]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:13:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:56 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b Jun 19 04:13:56 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:57 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b" returned: 0 in 1.007s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:57 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b Jun 19 04:13:57 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:58 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b" returned: 0 in 0.718s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Lock "cinder-quobyte-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b" released by "delete_volume" :: held 1.771s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Created reservations ['145f06c4-d0d7-4753-9a16-6d0694eb1700', 'c16246b4-c2ff-41d0-9661-599d20440a09', '8b6bdbf1-b1b3-4ecd-8c3a-fee4c3e9037f', '131e0d12-cb30-4925-bedf-18aff64f888c'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:58 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:13:58 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Acquiring lock "cinder-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Lock "cinder-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Acquiring lock "cinder-quobyte-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Lock "cinder-quobyte-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39" acquired by "delete_volume" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[67adc158-0fc0-422b-9c73-806e00f746e7]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:13:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:58 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:13:58 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:59 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39 Jun 19 04:13:59 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:59 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.903s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:13:59 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Deleted volume successfully. Jun 19 04:13:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7ebddf62-3a82-49cb-a704-0c2ddf5fb285 tempest-ServersNegativeTestJSON-1446247129 None] Lock "cinder-a4f9681c-4c5b-4cd6-a8a2-41f5935f540b-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:13:59 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.048s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:13:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:13:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 8 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:13:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:14:00 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39" returned: 0 in 1.074s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:00 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39 Jun 19 04:14:00 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:00 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39" returned: 0 in 0.828s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Lock "cinder-quobyte-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39" released by "delete_volume" :: held 1.991s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:14:00 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Created reservations ['03219e67-31bf-4b87-b771-60d687991180', '28c5e470-c661-4335-8957-ee417c8a4933', 'bd363668-e06c-4bb2-9083-bbaf8de977c1', '40342abf-800a-4539-ab19-295858c85959'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:14:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:01 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:14:01 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:01 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.841s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:01 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:14:01 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Deleted volume successfully. Jun 19 04:14:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3342c6ee-6cc6-446b-8420-bbc1545903f9 tempest-ServersNegativeTestJSON-1446247129 None] Lock "cinder-1ecf100f-6d13-49cb-b2dd-f31cecdc2c39-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:14:11 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=23,cinder:UPDATE=37,cinder:INSERT=10,cinder:DELETE=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:14:11 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=18,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=4 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:14:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-7b808b71-c49b-4c76-84c0-c91f555350ad req-2e60a0d0-3fdb-4165-9311-28465f8d3c0d tempest-TaggedAttachmentsTest-449671219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-7b808b71-c49b-4c76-84c0-c91f555350ad req-2e60a0d0-3fdb-4165-9311-28465f8d3c0d tempest-TaggedAttachmentsTest-449671219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:28 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88275c1-2fa2-46ae-94b1-60978072c41c]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-7b808b71-c49b-4c76-84c0-c91f555350ad req-2e60a0d0-3fdb-4165-9311-28465f8d3c0d tempest-TaggedAttachmentsTest-449671219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:28 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda Jun 19 04:14:28 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:29 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-7b808b71-c49b-4c76-84c0-c91f555350ad req-2e60a0d0-3fdb-4165-9311-28465f8d3c0d tempest-TaggedAttachmentsTest-449671219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda" returned: 0 in 0.871s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-7b808b71-c49b-4c76-84c0-c91f555350ad req-2e60a0d0-3fdb-4165-9311-28465f8d3c0d tempest-TaggedAttachmentsTest-449671219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.894s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-7b808b71-c49b-4c76-84c0-c91f555350ad req-2e60a0d0-3fdb-4165-9311-28465f8d3c0d tempest-TaggedAttachmentsTest-449671219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-9bf39cae-0b10-4b63-a260-18756d68bdda', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3dd95f71-bfe0-4415-b397-799fb6514779', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:14:29 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-7b808b71-c49b-4c76-84c0-c91f555350ad req-2e60a0d0-3fdb-4165-9311-28465f8d3c0d tempest-TaggedAttachmentsTest-449671219 None] attachment_update completed successfully. Jun 19 04:14:39 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:14:39 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Flow 'volume_create_manager' (95535941-04b7-4b33-84ce-547c75b30a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75676cc7-1fec-46e2-9326-107009f2095f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75676cc7-1fec-46e2-9326-107009f2095f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1770891724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd914b1-d7fe-48df-adc5-d4b9cdf8f836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4ed07cfb124f8f83dbd2ca853a1179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:41Z,use_quota=True,user_id='28fd3bd250ff4671a823b6851dbe570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3ba392-cef8-4cf0-be6d-c3d55aeae1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3ba392-cef8-4cf0-be6d-c3d55aeae1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5ac9cb-6a6a-43f2-aa2b-02940be49f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5ac9cb-6a6a-43f2-aa2b-02940be49f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd914b1-d7fe-48df-adc5-d4b9cdf8f836', 'volume_name': 'volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52f5a11-cc7e-4ac8-9ba9-48eb30b1ecea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52f5a11-cc7e-4ac8-9ba9-48eb30b1ecea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e56bcd-ab69-4c8a-88d3-aafa4033bed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:40 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Volume ddd914b1-d7fe-48df-adc5-d4b9cdf8f836: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836', 'volume_size': 1} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1770891724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd914b1-d7fe-48df-adc5-d4b9cdf8f836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4ed07cfb124f8f83dbd2ca853a1179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:41Z,use_quota=True,user_id='28fd3bd250ff4671a823b6851dbe570f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Creating volume ddd914b1-d7fe-48df-adc5-d4b9cdf8f836 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:14:40 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:14:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:40 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836 1073741824 Jun 19 04:14:40 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:41 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-c655b224-4856-4cae-8153-27100bc286c5 req-ff5c1b41-54ac-4977-82ae-2e34bc3e9701 tempest-TaggedAttachmentsTest-449671219 None] Terminate volume connection completed successfully. Jun 19 04:14:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-c655b224-4856-4cae-8153-27100bc286c5 req-ff5c1b41-54ac-4977-82ae-2e34bc3e9701 tempest-TaggedAttachmentsTest-449671219 None] Deleting attachment 3dd95f71-bfe0-4415-b397-799fb6514779. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:14:42 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836 1073741824" returned: 0 in 1.542s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:42 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836 Jun 19 04:14:42 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:43 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836" returned: 0 in 1.221s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] <== create_volume: return (2835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:14:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.842s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e56bcd-ab69-4c8a-88d3-aafa4033bed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4b7db9-211d-4417-9211-5ec8fa24104b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:43 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Volume volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836 (ddd914b1-d7fe-48df-adc5-d4b9cdf8f836): created successfully Jun 19 04:14:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4b7db9-211d-4417-9211-5ec8fa24104b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Flow 'volume_create_manager' (95535941-04b7-4b33-84ce-547c75b30a19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:43 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f137f56b-a5ae-4d0c-9f5c-86fe529d7e6f tempest-VolumesAdminNegativeTest-334534914 None] Created volume successfully. Jun 19 04:14:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Acquiring lock "cinder-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:14:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Lock "cinder-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:14:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Acquiring lock "cinder-quobyte-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:14:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Lock "cinder-quobyte-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836" acquired by "delete_volume" :: waited 0.046s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:14:44 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a2f63a-887b-4a65-b187-bd866a1e4675]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:45 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836 Jun 19 04:14:45 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:47 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836" returned: 0 in 2.143s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:47 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836 Jun 19 04:14:47 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:49 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836" returned: 0 in 2.102s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:49 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Lock "cinder-quobyte-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836" released by "delete_volume" :: held 4.383s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:14:49 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Created reservations ['20fe3242-a881-4e24-b57d-51542d0016cd', 'c6378f67-54f3-46ca-92b0-d437ea2f4700', '630a878b-0000-4fb4-8e0e-ceacc699a4e0', '097584e5-6f59-44d0-88da-bba76395f161'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:14:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:49 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:14:49 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:51 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.395s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:51 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:14:51 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Deleted volume successfully. Jun 19 04:14:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-944db147-768b-4e51-baf3-125193cea2ce tempest-VolumesAdminNegativeTest-334534914 None] Lock "cinder-ddd914b1-d7fe-48df-adc5-d4b9cdf8f836-delete_volume" released by "delete_volume" :: held 6.423s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:14:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:14:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:58 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:14:58 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:59 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=12,cinder:SELECT=9,cinder:INSERT=2 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:14:59 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.942s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:14:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:14:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 8 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:14:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:15:01 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=2 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Flow 'volume_create_manager' (d4880d3d-1ce6-4ad4-bea6-00f61329a19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af718f08-66e0-4953-b208-ab1d20d88a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af718f08-66e0-4953-b208-ab1d20d88a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-626023264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727b4c25-face-4843-9ae0-e127b2a760e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad48b01517234196968be5a02cf1ee0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:15:05Z,use_quota=True,user_id='0e913c2864064d47b331524d44b2596f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0f191c-1292-4e70-baeb-0e2809e61537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0f191c-1292-4e70-baeb-0e2809e61537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57b1e38-a8ba-43b8-b1de-32ccbdf964eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57b1e38-a8ba-43b8-b1de-32ccbdf964eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '727b4c25-face-4843-9ae0-e127b2a760e3', 'volume_name': 'volume-727b4c25-face-4843-9ae0-e127b2a760e3', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4d4f0a-fab9-42da-a427-b341224aaf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4d4f0a-fab9-42da-a427-b341224aaf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f3125e-4bd0-40d2-ba79-349b241a05ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:04 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Volume 727b4c25-face-4843-9ae0-e127b2a760e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-727b4c25-face-4843-9ae0-e127b2a760e3', 'volume_size': 1} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-626023264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727b4c25-face-4843-9ae0-e127b2a760e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad48b01517234196968be5a02cf1ee0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:15:05Z,use_quota=True,user_id='0e913c2864064d47b331524d44b2596f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Creating volume 727b4c25-face-4843-9ae0-e127b2a760e3 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:15:04 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:15:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:04 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3 1073741824 Jun 19 04:15:04 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:06 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3 1073741824" returned: 0 in 1.314s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:06 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3 Jun 19 04:15:06 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Acquiring lock "cinder-9bf39cae-0b10-4b63-a260-18756d68bdda-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Lock "cinder-9bf39cae-0b10-4b63-a260-18756d68bdda-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Acquiring lock "cinder-quobyte-9bf39cae-0b10-4b63-a260-18756d68bdda" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:07 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Lock "cinder-quobyte-9bf39cae-0b10-4b63-a260-18756d68bdda" acquired by "delete_volume" :: waited 0.129s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:07 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[05874228-1561-427f-8052-cee4e1f240c7]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:07 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda Jun 19 04:15:07 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:07 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3" returned: 0 in 1.335s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] <== create_volume: return (2738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:15:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.743s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f3125e-4bd0-40d2-ba79-349b241a05ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-727b4c25-face-4843-9ae0-e127b2a760e3', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca39f90-1fa5-4e57-aaa0-cb659301366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:07 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Volume volume-727b4c25-face-4843-9ae0-e127b2a760e3 (727b4c25-face-4843-9ae0-e127b2a760e3): created successfully Jun 19 04:15:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cca39f90-1fa5-4e57-aaa0-cb659301366f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Flow 'volume_create_manager' (d4880d3d-1ce6-4ad4-bea6-00f61329a19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:15:07 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-474d0c9c-3aeb-4655-9b59-7ed450606196 tempest-ServerActionsTestOtherA-1552187486 None] Created volume successfully. Jun 19 04:15:08 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda" returned: 0 in 1.263s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:08 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda Jun 19 04:15:08 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:09 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9bf39cae-0b10-4b63-a260-18756d68bdda" returned: 0 in 0.863s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:09 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Lock "cinder-quobyte-9bf39cae-0b10-4b63-a260-18756d68bdda" released by "delete_volume" :: held 2.217s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:09 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Created reservations ['47fe19f2-12ea-44e4-821b-34eca078640c', 'f70dc456-1331-40cf-99f3-16ec2e1dfbd7', 'e7c4e963-6047-4c46-b6c3-41f1091cdec4', 'a80489ad-90ac-4819-aaeb-866828956019'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:09 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:15:09 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:10 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.974s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:10 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:15:10 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Deleted volume successfully. Jun 19 04:15:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-cf709619-90e9-4ec6-a880-1d7ecb6e02bc tempest-TaggedAttachmentsTest-449671219 None] Lock "cinder-9bf39cae-0b10-4b63-a260-18756d68bdda-delete_volume" released by "delete_volume" :: held 3.624s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:19 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=13,cinder:SELECT=4,cinder:INSERT=4 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:15:20 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=10,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Flow 'volume_create_manager' (f4a43357-0949-4481-8049-4cc36938b606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa83a35-8d2f-4ce8-9f9f-cfd32e21c08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa83a35-8d2f-4ce8-9f9f-cfd32e21c08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-830895363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8003b2-ecdc-4f24-a811-e16704f74c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e9659344aa450684ed52158a41cb97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:15:23Z,use_quota=True,user_id='7faf25cc37e643adbc765456a666d526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a37a81-a46a-4a1f-8bcc-5a39a216e11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60a37a81-a46a-4a1f-8bcc-5a39a216e11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c51ac7e-2b0a-48af-9f63-b9a99e15a8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c51ac7e-2b0a-48af-9f63-b9a99e15a8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a8003b2-ecdc-4f24-a811-e16704f74c6a', 'volume_name': 'volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4327446f-e46d-4726-a73d-08be164326c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4327446f-e46d-4726-a73d-08be164326c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9883ce-8592-4432-85c7-f39e0668639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:23 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Volume 8a8003b2-ecdc-4f24-a811-e16704f74c6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a', 'volume_size': 1} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-830895363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8003b2-ecdc-4f24-a811-e16704f74c6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e9659344aa450684ed52158a41cb97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:15:23Z,use_quota=True,user_id='7faf25cc37e643adbc765456a666d526',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Creating volume 8a8003b2-ecdc-4f24-a811-e16704f74c6a {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:15:23 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:15:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:23 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a 1073741824 Jun 19 04:15:23 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:25 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a 1073741824" returned: 0 in 1.742s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:25 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a Jun 19 04:15:25 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:26 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a" returned: 0 in 1.373s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] <== create_volume: return (3210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:15:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.215s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9883ce-8592-4432-85c7-f39e0668639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3dbfb1-134a-4674-8685-0b247c3d4234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:27 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Volume volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a (8a8003b2-ecdc-4f24-a811-e16704f74c6a): created successfully Jun 19 04:15:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3dbfb1-134a-4674-8685-0b247c3d4234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Flow 'volume_create_manager' (f4a43357-0949-4481-8049-4cc36938b606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:15:27 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-7f6897d8-ae9a-467e-b732-497f805eb909 tempest-AttachVolumeShelveTestJSON-1818868376 None] Created volume successfully. Jun 19 04:15:32 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-247a8704-04ac-478e-9860-d332faa6a2be tempest-GroupSnapshotsTest-551423306 None] Group tempest-GroupSnapshotsTest-Group-541410710: creating Jun 19 04:15:32 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-247a8704-04ac-478e-9860-d332faa6a2be tempest-GroupSnapshotsTest-551423306 None] Group tempest-GroupSnapshotsTest-Group-541410710: created successfully Jun 19 04:15:32 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-247a8704-04ac-478e-9860-d332faa6a2be tempest-GroupSnapshotsTest-551423306 None] Create group completed successfully. Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Flow 'volume_create_manager' (a224c77a-edf7-490e-9bd1-905533ff222b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da669659-1c1a-412e-a41d-8b31c4c3d37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da669659-1c1a-412e-a41d-8b31c4c3d37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-405344251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72af74d9-d15e-40e4-956c-6718d3304a8e,host='devstack@QuobyteHD#QuobyteHD',id=6b20ff5b-9df2-4db6-9b5f-611126b7331e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6eca1f2c1514cea9bc577af6b39feae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:15:34Z,use_quota=True,user_id='46afa46086d64b4d9af5153beccf418b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58db2d49-1cb5-4f58-a9b9-4fd238e962ad),volume_type_id=58db2d49-1cb5-4f58-a9b9-4fd238e962ad)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400bf48d-6d30-4236-871f-b613b8775496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400bf48d-6d30-4236-871f-b613b8775496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4145b1-f38f-4fc0-b43e-70c171e66668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb4145b1-f38f-4fc0-b43e-70c171e66668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b20ff5b-9df2-4db6-9b5f-611126b7331e', 'volume_name': 'volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc858c44-dfa0-42de-be71-2950950d4eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc858c44-dfa0-42de-be71-2950950d4eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd5c8bc-1d7e-4b71-bb55-0b0059abf1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:34 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Volume 6b20ff5b-9df2-4db6-9b5f-611126b7331e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e', 'volume_size': 1} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=72af74d9-d15e-40e4-956c-6718d3304a8e,created_at=2026-06-19T02:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-405344251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72af74d9-d15e-40e4-956c-6718d3304a8e,host='devstack@QuobyteHD#QuobyteHD',id=6b20ff5b-9df2-4db6-9b5f-611126b7331e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6eca1f2c1514cea9bc577af6b39feae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:15:34Z,use_quota=True,user_id='46afa46086d64b4d9af5153beccf418b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58db2d49-1cb5-4f58-a9b9-4fd238e962ad),volume_type_id=58db2d49-1cb5-4f58-a9b9-4fd238e962ad)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Creating volume 6b20ff5b-9df2-4db6-9b5f-611126b7331e {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:15:34 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:15:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:34 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e 1073741824 Jun 19 04:15:34 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:35 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e 1073741824" returned: 0 in 1.197s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:36 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e Jun 19 04:15:36 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:37 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e" returned: 0 in 1.209s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] <== create_volume: return (2491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:15:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.494s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd5c8bc-1d7e-4b71-bb55-0b0059abf1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63a10d0-f172-4ee8-83e8-81b9d242f320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:15:37 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Volume volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e (6b20ff5b-9df2-4db6-9b5f-611126b7331e): created successfully Jun 19 04:15:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63a10d0-f172-4ee8-83e8-81b9d242f320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:15:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Flow 'volume_create_manager' (a224c77a-edf7-490e-9bd1-905533ff222b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:15:37 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-52997c76-da25-498f-a524-b845c24fa03c tempest-GroupSnapshotsTest-551423306 None] Created volume successfully. Jun 19 04:15:39 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] GroupSnapshot 553e3992-cd14-49b2-ac4c-fd3112fcb9af: creating. Jun 19 04:15:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] Group snapshot 553e3992-cd14-49b2-ac4c-fd3112fcb9af: creating. {{(pid=93530) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 19 04:15:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:39 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] Creating offline snapshot d0e0b699-e102-4aba-ba21-b859bc1afb55 of volume 6b20ff5b-9df2-4db6-9b5f-611126b7331e {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:15:39 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[724f94e1-2ecf-42ad-ae4f-47ff476cde9f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:39 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e Jun 19 04:15:39 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:40 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e" returned: 0 in 1.005s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:40 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 1G Jun 19 04:15:40 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:41 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 1G" returned: 0 in 0.877s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:41 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 Jun 19 04:15:41 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:41 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55" returned: 0 in 0.753s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:41 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:15:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:41 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 Jun 19 04:15:41 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:42 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55" returned: 0 in 0.662s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:42 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.info Jun 19 04:15:42 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:43 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.info" returned: 0 in 0.718s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:43 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:15:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:43 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.info Jun 19 04:15:43 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:43 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.info" returned: 0 in 0.725s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.826s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:44 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-689f8335-cdc5-4f69-8340-075315ce88d2 tempest-GroupSnapshotsTest-551423306 None] group_snapshot 553e3992-cd14-49b2-ac4c-fd3112fcb9af: created successfully Jun 19 04:15:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-d0e0b699-e102-4aba-ba21-b859bc1afb55-8c735a23-0a86-480a-b736-7fc42110b909" by "_create_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-d0e0b699-e102-4aba-ba21-b859bc1afb55-8c735a23-0a86-480a-b736-7fc42110b909" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Creating volume 8c735a23-0a86-480a-b736-7fc42110b909 from snapshot d0e0b699-e102-4aba-ba21-b859bc1afb55 {{(pid=93530) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:15:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:15:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-8c735a23-0a86-480a-b736-7fc42110b909" by "_copy_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-8c735a23-0a86-480a-b736-7fc42110b909" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] snapshot: d0e0b699-e102-4aba-ba21-b859bc1afb55, volume: 8c735a23-0a86-480a-b736-7fc42110b909, {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:15:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:46 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[722ae43c-9a4e-4274-a393-e6b9fa397f35]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:46 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 Jun 19 04:15:46 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-68fc9e44-3f76-4784-b261-584bf5943bb6 req-f59dc31e-5d58-4cb5-9f8e-67957199caa4 tempest-AttachVolumeShelveTestJSON-1818868376 None] No connector for attachment 3f2804d6-5b73-4706-93eb-013373065582; skipping storage backend terminate_connection call. {{(pid=93530) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 19 04:15:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-68fc9e44-3f76-4784-b261-584bf5943bb6 req-f59dc31e-5d58-4cb5-9f8e-67957199caa4 tempest-AttachVolumeShelveTestJSON-1818868376 None] Deleting attachment 3f2804d6-5b73-4706-93eb-013373065582. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:15:47 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55" returned: 0 in 1.319s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:15:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:15:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Creating direct copy from snapshot {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:15:47 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac71d46-c5c4-4bc8-8508-b7288149dd0a]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:47 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e Jun 19 04:15:47 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:48 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e" returned: 0 in 0.964s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:48 devstack cinder-volume[93530]: DEBUG cinder.utils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Path /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909 not found in is_blk_device check {{(pid=93530) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:15:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:48 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909 Jun 19 04:15:48 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:55 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909" returned: 0 in 7.197s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:55 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ced9a7-2ec3-49af-8c16-86dc1b3c00a4]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:55 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e Jun 19 04:15:55 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-785d287d-6ec0-4449-a7b9-164ffa1bb5f2 req-fe5ea017-df8a-4d5b-aeb7-2e878e89d717 tempest-ServerActionsTestOtherA-1552187486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:57 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e" returned: 0 in 1.398s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:57 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Image conversion details: src /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e, size 1024.00 MB, duration 7.20 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:15:57 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Converted 1024.00 MB image at 142.22 MB/s Jun 19 04:15:57 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:15:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:57 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909 Jun 19 04:15:57 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:57 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909" returned: 0 in 0.920s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:57 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-8c735a23-0a86-480a-b736-7fc42110b909" released by "_copy_volume_from_snapshot" :: held 11.937s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:57 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-d0e0b699-e102-4aba-ba21-b859bc1afb55-8c735a23-0a86-480a-b736-7fc42110b909" released by "_create_volume_from_snapshot" :: held 12.008s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.034s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-785d287d-6ec0-4449-a7b9-164ffa1bb5f2 req-fe5ea017-df8a-4d5b-aeb7-2e878e89d717 tempest-ServerActionsTestOtherA-1552187486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.486s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:58 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf0d683-377b-4b6c-99e6-cba28f164289]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-785d287d-6ec0-4449-a7b9-164ffa1bb5f2 req-fe5ea017-df8a-4d5b-aeb7-2e878e89d717 tempest-ServerActionsTestOtherA-1552187486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:58 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d3972509-f045-4587-980b-76badb41ce0c tempest-GroupSnapshotsTest-551423306 None] Create group from source-snapshot-553e3992-cd14-49b2-ac4c-fd3112fcb9af completed successfully. Jun 19 04:15:58 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3 Jun 19 04:15:58 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:15:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:58 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:15:58 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:59 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-785d287d-6ec0-4449-a7b9-164ffa1bb5f2 req-fe5ea017-df8a-4d5b-aeb7-2e878e89d717 tempest-ServerActionsTestOtherA-1552187486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3" returned: 0 in 1.697s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-785d287d-6ec0-4449-a7b9-164ffa1bb5f2 req-fe5ea017-df8a-4d5b-aeb7-2e878e89d717 tempest-ServerActionsTestOtherA-1552187486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.751s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-785d287d-6ec0-4449-a7b9-164ffa1bb5f2 req-fe5ea017-df8a-4d5b-aeb7-2e878e89d717 tempest-ServerActionsTestOtherA-1552187486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-727b4c25-face-4843-9ae0-e127b2a760e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd58fbf9-f098-4cd0-9909-54e5bc2df36e', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:16:00 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-785d287d-6ec0-4449-a7b9-164ffa1bb5f2 req-fe5ea017-df8a-4d5b-aeb7-2e878e89d717 tempest-ServerActionsTestOtherA-1552187486 None] attachment_update completed successfully. Jun 19 04:16:01 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 2.351s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:01 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:16:01 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:16:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 8 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:16:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:16:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-8c735a23-0a86-480a-b736-7fc42110b909" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-8c735a23-0a86-480a-b736-7fc42110b909" acquired by "delete_volume" :: waited 0.031s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:01 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[238141d2-9e20-4b0d-a775-ba0d4f86dfdb]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:01 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909 Jun 19 04:16:01 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:03 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909" returned: 0 in 2.022s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:03 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909 Jun 19 04:16:03 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:05 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8c735a23-0a86-480a-b736-7fc42110b909" returned: 0 in 1.959s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:05 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-8c735a23-0a86-480a-b736-7fc42110b909" released by "delete_volume" :: held 4.064s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:05 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Created reservations ['c6f7c69b-188e-46fd-8c1a-d9d4b4c30538'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:05 devstack cinder-volume[93530]: WARNING cinder.quota [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1019697221 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1019697221, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:16:05 devstack cinder-volume[93530]: WARNING cinder.quota [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1019697221 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1019697221, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:16:05 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Created reservations ['575c7c63-568e-4ebe-a179-04a0e468fb88', 'e6588b21-7ea8-4fc2-ab14-216c63bc198d', '246f9888-a3ee-4845-ab63-a0aefc5205c6', '26ca54b3-6b58-4913-a1c5-0553b76bf82b'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:06 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:16:06 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:06 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] group_snapshot 553e3992-cd14-49b2-ac4c-fd3112fcb9af: deleting Jun 19 04:16:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] group_snapshot 553e3992-cd14-49b2-ac4c-fd3112fcb9af: deleting {{(pid=93530) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 19 04:16:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-6b20ff5b-9df2-4db6-9b5f-611126b7331e" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-6b20ff5b-9df2-4db6-9b5f-611126b7331e" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-d0e0b699-e102-4aba-ba21-b859bc1afb55" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-d0e0b699-e102-4aba-ba21-b859bc1afb55" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] Deleting offline snapshot d0e0b699-e102-4aba-ba21-b859bc1afb55 of volume 6b20ff5b-9df2-4db6-9b5f-611126b7331e {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:16:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] snapshot_file for this snap is: volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:16:06 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[2762f196-15ad-4328-a2ba-3c0539f9cf5b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:06 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 Jun 19 04:16:06 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:08 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 2.386s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:08 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:16:08 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ecaec12c-18ed-4f63-95d3-246ddcf9eeea tempest-GroupSnapshotsTest-551423306 None] Delete group completed successfully. Jun 19 04:16:08 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55" returned: 0 in 1.743s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:16:08 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f8da12-4162-4573-88a1-60d007eea278]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:08 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e Jun 19 04:16:08 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:09 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e" returned: 0 in 1.324s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:09 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 Jun 19 04:16:09 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:11 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55" returned: 0 in 1.670s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:11 devstack sudo[97933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55 Jun 19 04:16:11 devstack sudo[97933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:12 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-5fcccc17-b2ec-45eb-8f45-c23e2fdae3bf req-ca30b1f8-4828-4633-b70f-f29abaa02f8c tempest-ServerActionsTestOtherA-1552187486 None] Terminate volume connection completed successfully. Jun 19 04:16:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-5fcccc17-b2ec-45eb-8f45-c23e2fdae3bf req-ca30b1f8-4828-4633-b70f-f29abaa02f8c tempest-ServerActionsTestOtherA-1552187486 None] Deleting attachment cd58fbf9-f098-4cd0-9909-54e5bc2df36e. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:16:12 devstack sudo[97933]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e.d0e0b699-e102-4aba-ba21-b859bc1afb55" returned: 0 in 1.066s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-d0e0b699-e102-4aba-ba21-b859bc1afb55" released by "_delete_snapshot" :: held 6.042s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-6b20ff5b-9df2-4db6-9b5f-611126b7331e" released by "delete_snapshot" :: held 6.112s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:12 devstack cinder-volume[93530]: WARNING cinder.quota [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1019697221 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1019697221, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:16:12 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] Created reservations ['48993765-334b-4be8-86b6-389e73b2eb24', '8af8d267-f0d2-4032-8be4-2d64c4e435f8', 'c48147cf-5333-4648-a8d9-932b32b43954', '6a893839-39f6-4b38-9394-00fe7fa8ba13'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:12 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-af22a2ed-bd1d-4e13-924b-bbecd37b1c98 tempest-GroupSnapshotsTest-551423306 None] group_snapshot 553e3992-cd14-49b2-ac4c-fd3112fcb9af: deleted successfully Jun 19 04:16:13 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-6b20ff5b-9df2-4db6-9b5f-611126b7331e" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:13 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-6b20ff5b-9df2-4db6-9b5f-611126b7331e" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:13 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[59db8d6c-e333-4d04-ab3c-4cadd3c1a639]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:13 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e Jun 19 04:16:13 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:14 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e" returned: 0 in 0.796s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:14 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e Jun 19 04:16:14 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-5fcccc17-b2ec-45eb-8f45-c23e2fdae3bf req-099f1034-72ed-4319-a7ff-5ad4ca11ad85 tempest-ServerActionsTestOtherA-1552187486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-5fcccc17-b2ec-45eb-8f45-c23e2fdae3bf req-099f1034-72ed-4319-a7ff-5ad4ca11ad85 tempest-ServerActionsTestOtherA-1552187486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:14 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[6179d816-211e-403e-a68d-c59975b10241]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-5fcccc17-b2ec-45eb-8f45-c23e2fdae3bf req-099f1034-72ed-4319-a7ff-5ad4ca11ad85 tempest-ServerActionsTestOtherA-1552187486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:15 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3 Jun 19 04:16:15 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:15 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b20ff5b-9df2-4db6-9b5f-611126b7331e" returned: 0 in 0.725s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-6b20ff5b-9df2-4db6-9b5f-611126b7331e" released by "delete_volume" :: held 1.604s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:15 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Created reservations ['fa65342d-75a7-4b65-85ab-920590a23da8'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:15 devstack cinder-volume[93530]: WARNING cinder.db.api [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1019697221'] Jun 19 04:16:15 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Created reservations ['88f96521-3c1c-4fb4-b919-956d8d11c1c0', 'd458f330-3106-41ee-8e0a-b0cffef8466e', '74b367b6-220f-4446-b1d4-7ae465be2171', 'f78b623c-0ed7-48e8-aed4-1404f321599e'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:15 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:16:15 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:15 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-5fcccc17-b2ec-45eb-8f45-c23e2fdae3bf req-099f1034-72ed-4319-a7ff-5ad4ca11ad85 tempest-ServerActionsTestOtherA-1552187486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3" returned: 0 in 0.859s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-5fcccc17-b2ec-45eb-8f45-c23e2fdae3bf req-099f1034-72ed-4319-a7ff-5ad4ca11ad85 tempest-ServerActionsTestOtherA-1552187486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.876s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-5fcccc17-b2ec-45eb-8f45-c23e2fdae3bf req-099f1034-72ed-4319-a7ff-5ad4ca11ad85 tempest-ServerActionsTestOtherA-1552187486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-727b4c25-face-4843-9ae0-e127b2a760e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02ff5300-932d-43ae-9bb9-54f98ea0dd77', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:16:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-5fcccc17-b2ec-45eb-8f45-c23e2fdae3bf req-099f1034-72ed-4319-a7ff-5ad4ca11ad85 tempest-ServerActionsTestOtherA-1552187486 None] attachment_update completed successfully. Jun 19 04:16:16 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.723s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:16 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:16:16 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-1552abea-6d03-4ee3-9ae3-83e743f8b2c6 tempest-GroupSnapshotsTest-551423306 None] Delete group completed successfully. Jun 19 04:16:16 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e3558bde-a9e1-4733-9be8-4757e840b05d tempest-GroupSnapshotsTest-551423306 None] Group tempest-GroupSnapshotsTest-Group-925573243: creating Jun 19 04:16:16 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e3558bde-a9e1-4733-9be8-4757e840b05d tempest-GroupSnapshotsTest-551423306 None] Group tempest-GroupSnapshotsTest-Group-925573243: created successfully Jun 19 04:16:16 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e3558bde-a9e1-4733-9be8-4757e840b05d tempest-GroupSnapshotsTest-551423306 None] Create group completed successfully. Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Flow 'volume_create_manager' (25e512a9-7558-4412-b5f2-405d1c89f710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0f4610-9305-4d9a-9f05-ee08eac2dcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=60,cinder:UPDATE=40,cinder:INSERT=13 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0f4610-9305-4d9a-9f05-ee08eac2dcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-818207948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1de53cd-707b-4c18-aa92-f2632d408c8d,host='devstack@QuobyteHD#QuobyteHD',id=fe614141-660d-48c7-9eeb-366066c00a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6eca1f2c1514cea9bc577af6b39feae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:19Z,use_quota=True,user_id='46afa46086d64b4d9af5153beccf418b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e2cbe46-3c26-4c6c-80ae-d0909d3dd067),volume_type_id=5e2cbe46-3c26-4c6c-80ae-d0909d3dd067)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef029370-448d-4668-8aeb-a27c01549e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef029370-448d-4668-8aeb-a27c01549e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d820ec-ea24-4ae1-9346-76f133353163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84d820ec-ea24-4ae1-9346-76f133353163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe614141-660d-48c7-9eeb-366066c00a35', 'volume_name': 'volume-fe614141-660d-48c7-9eeb-366066c00a35', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584643c2-366b-47f7-9722-2a3cdd75e7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584643c2-366b-47f7-9722-2a3cdd75e7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826acd87-9c21-42d1-b973-09f913b863f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:19 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Volume fe614141-660d-48c7-9eeb-366066c00a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe614141-660d-48c7-9eeb-366066c00a35', 'volume_size': 1} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f1de53cd-707b-4c18-aa92-f2632d408c8d,created_at=2026-06-19T02:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-818207948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1de53cd-707b-4c18-aa92-f2632d408c8d,host='devstack@QuobyteHD#QuobyteHD',id=fe614141-660d-48c7-9eeb-366066c00a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6eca1f2c1514cea9bc577af6b39feae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:19Z,use_quota=True,user_id='46afa46086d64b4d9af5153beccf418b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e2cbe46-3c26-4c6c-80ae-d0909d3dd067),volume_type_id=5e2cbe46-3c26-4c6c-80ae-d0909d3dd067)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Creating volume fe614141-660d-48c7-9eeb-366066c00a35 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:16:19 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:16:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:19 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35 1073741824 Jun 19 04:16:19 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:21 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35 1073741824" returned: 0 in 2.148s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:21 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=45,cinder:SELECT=52,cinder:INSERT=4,cinder:DELETE=2 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:16:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:21 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35 Jun 19 04:16:21 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:23 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35" returned: 0 in 1.454s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] <== create_volume: return (3697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.704s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826acd87-9c21-42d1-b973-09f913b863f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe614141-660d-48c7-9eeb-366066c00a35', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ece6c3-a16a-4bde-8233-e878d2fe007d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:23 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Volume volume-fe614141-660d-48c7-9eeb-366066c00a35 (fe614141-660d-48c7-9eeb-366066c00a35): created successfully Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ece6c3-a16a-4bde-8233-e878d2fe007d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Flow 'volume_create_manager' (25e512a9-7558-4412-b5f2-405d1c89f710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:23 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f02db83d-5f4d-4b72-a8d5-dc1417f26062 tempest-GroupSnapshotsTest-551423306 None] Created volume successfully. Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Flow 'volume_create_manager' (1da37dff-c0ae-418f-9963-360d8ecb836d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258ded91-ba37-4379-bcfc-63c4be8e64cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258ded91-ba37-4379-bcfc-63c4be8e64cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-785762068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb66b8bb4e94c9fa94f60e4f4a39b93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:23Z,use_quota=True,user_id='299427200b6a43508fe71ac1315684da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9774062-1e8c-4365-a540-209eed766400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9774062-1e8c-4365-a540-209eed766400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae33f282-3f16-4c77-9618-9dfaa1255477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae33f282-3f16-4c77-9618-9dfaa1255477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5', 'volume_name': 'volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20985bd8-c92c-4ac2-8de7-12e232c34658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20985bd8-c92c-4ac2-8de7-12e232c34658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe8e079-8f06-497d-98dc-3cd7c17547a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:23 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Volume 9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5', 'volume_size': 1} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-785762068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb66b8bb4e94c9fa94f60e4f4a39b93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:23Z,use_quota=True,user_id='299427200b6a43508fe71ac1315684da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Creating volume 9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:16:23 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:16:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:23 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5 1073741824 Jun 19 04:16:23 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:25 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5 1073741824" returned: 0 in 1.697s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:25 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:16:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Flow 'volume_create_manager' (592f088e-108d-4f21-b512-9d2f3afa6dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:25 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5 Jun 19 04:16:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233e4e81-61a5-4250-a672-fe824be21c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:25 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233e4e81-61a5-4250-a672-fe824be21c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1852775111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1de53cd-707b-4c18-aa92-f2632d408c8d,host='devstack@QuobyteHD#QuobyteHD',id=ea42bba2-b95e-4727-a50d-95912980e985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6eca1f2c1514cea9bc577af6b39feae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:25Z,use_quota=True,user_id='46afa46086d64b4d9af5153beccf418b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e2cbe46-3c26-4c6c-80ae-d0909d3dd067),volume_type_id=5e2cbe46-3c26-4c6c-80ae-d0909d3dd067)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99356808-a35f-4051-bda3-114863a6acb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99356808-a35f-4051-bda3-114863a6acb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544e4282-252a-4203-96dc-73dd2c139df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (544e4282-252a-4203-96dc-73dd2c139df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea42bba2-b95e-4727-a50d-95912980e985', 'volume_name': 'volume-ea42bba2-b95e-4727-a50d-95912980e985', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a37a180-cfd4-4aba-96f2-160d12290ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a37a180-cfd4-4aba-96f2-160d12290ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603165a5-2016-410e-87bc-e14b808569a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:25 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Volume ea42bba2-b95e-4727-a50d-95912980e985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea42bba2-b95e-4727-a50d-95912980e985', 'volume_size': 1} Jun 19 04:16:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:26 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5" returned: 0 in 1.278s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] <== create_volume: return (3200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.202s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.036s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f1de53cd-707b-4c18-aa92-f2632d408c8d,created_at=2026-06-19T02:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1852775111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f1de53cd-707b-4c18-aa92-f2632d408c8d,host='devstack@QuobyteHD#QuobyteHD',id=ea42bba2-b95e-4727-a50d-95912980e985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6eca1f2c1514cea9bc577af6b39feae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:25Z,use_quota=True,user_id='46afa46086d64b4d9af5153beccf418b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e2cbe46-3c26-4c6c-80ae-d0909d3dd067),volume_type_id=5e2cbe46-3c26-4c6c-80ae-d0909d3dd067)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Creating volume ea42bba2-b95e-4727-a50d-95912980e985 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:16:26 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe8e079-8f06-497d-98dc-3cd7c17547a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410529af-91ae-4df0-af28-28da014c91c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:26 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985 1073741824 Jun 19 04:16:26 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:26 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Volume volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5 (9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5): created successfully Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410529af-91ae-4df0-af28-28da014c91c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Flow 'volume_create_manager' (1da37dff-c0ae-418f-9963-360d8ecb836d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:26 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f9ab05a8-7a0a-4f72-8f1d-ddf4213f604d tempest-ServerRescueNegativeTestJSON-185148190 None] Created volume successfully. Jun 19 04:16:28 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985 1073741824" returned: 0 in 1.234s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:28 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985 Jun 19 04:16:28 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:29 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985" returned: 0 in 1.587s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] <== create_volume: return (2883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:16:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.891s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603165a5-2016-410e-87bc-e14b808569a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea42bba2-b95e-4727-a50d-95912980e985', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e8a824-6bed-4302-ab6f-f6a960eeeb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:29 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Volume volume-ea42bba2-b95e-4727-a50d-95912980e985 (ea42bba2-b95e-4727-a50d-95912980e985): created successfully Jun 19 04:16:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e8a824-6bed-4302-ab6f-f6a960eeeb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Flow 'volume_create_manager' (592f088e-108d-4f21-b512-9d2f3afa6dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:29 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f535d009-6874-4fa8-94de-b413dc8d58e6 tempest-GroupSnapshotsTest-551423306 None] Created volume successfully. Jun 19 04:16:30 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-84f2801a-446f-42cb-98a7-ef487147d29d tempest-GroupSnapshotsTest-551423306 None] Update group completed successfully. Jun 19 04:16:31 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-371222d1-a46b-455e-8213-6fe50dd1a226 tempest-GroupSnapshotsTest-551423306 None] Update group completed successfully. Jun 19 04:16:33 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-0e205397-6af1-4bae-b923-ca3700ecb26a tempest-GroupSnapshotsTest-551423306 None] Update group completed successfully. Jun 19 04:16:34 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f66c9597-16b0-4ce1-bc58-b3f005bca9f2 tempest-GroupSnapshotsTest-551423306 None] Update group completed successfully. Jun 19 04:16:36 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] GroupSnapshot e4eae4a0-8414-4466-9227-4ffa3c60a327: creating. Jun 19 04:16:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Group snapshot e4eae4a0-8414-4466-9227-4ffa3c60a327: creating. {{(pid=93530) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 19 04:16:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Creating offline snapshot 561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 of volume ea42bba2-b95e-4727-a50d-95912980e985 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:16:36 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebc04a9-fe18-4c07-b70c-13cf181e2e04]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:36 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985 Jun 19 04:16:36 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:37 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985" returned: 0 in 1.045s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:37 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 1G Jun 19 04:16:37 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:38 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 1G" returned: 0 in 0.892s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea42bba2-b95e-4727-a50d-95912980e985 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:38 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea42bba2-b95e-4727-a50d-95912980e985 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 Jun 19 04:16:38 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:39 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea42bba2-b95e-4727-a50d-95912980e985 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2" returned: 0 in 0.862s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:39 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:16:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:39 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 Jun 19 04:16:39 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2" returned: 0 in 0.843s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:39 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:39 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.info Jun 19 04:16:39 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:40 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.info" returned: 0 in 0.781s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:40 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:16:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:40 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.info Jun 19 04:16:40 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:41 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.info" returned: 0 in 0.761s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.336s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Creating offline snapshot 6b30c655-2d9d-41db-b238-7ff1a8ac58cd of volume fe614141-660d-48c7-9eeb-366066c00a35 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:16:41 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde0a4c3-8158-4fa8-a9ef-b13e809f1a1f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:41 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35 Jun 19 04:16:41 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:42 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35" returned: 0 in 0.942s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:42 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd 1G Jun 19 04:16:42 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:43 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd 1G" returned: 0 in 1.131s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe614141-660d-48c7-9eeb-366066c00a35 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:43 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe614141-660d-48c7-9eeb-366066c00a35 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd Jun 19 04:16:43 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:44 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe614141-660d-48c7-9eeb-366066c00a35 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd" returned: 0 in 1.353s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:44 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:16:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:44 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd Jun 19 04:16:44 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:45 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd" returned: 0 in 0.877s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:45 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.info Jun 19 04:16:45 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:46 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.info" returned: 0 in 0.916s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:46 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:16:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:46 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.info Jun 19 04:16:46 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:47 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.info" returned: 0 in 0.825s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.178s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:47 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f8c0a30a-bd52-4760-924f-1f2a986445c6 tempest-GroupSnapshotsTest-551423306 None] group_snapshot e4eae4a0-8414-4466-9227-4ffa3c60a327: created successfully Jun 19 04:16:49 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] group_snapshot e4eae4a0-8414-4466-9227-4ffa3c60a327: deleting Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] group_snapshot e4eae4a0-8414-4466-9227-4ffa3c60a327: deleting {{(pid=93530) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-ea42bba2-b95e-4727-a50d-95912980e985" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-ea42bba2-b95e-4727-a50d-95912980e985" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Deleting offline snapshot 561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 of volume ea42bba2-b95e-4727-a50d-95912980e985 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] snapshot_file for this snap is: volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Acquiring lock "cinder-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Lock "cinder-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32c9585-59e9-4311-900d-94f0748223cf]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Acquiring lock "cinder-quobyte-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Lock "cinder-quobyte-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[934e2c39-72e3-4c46-8c94-c01dd375c29f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:49 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 Jun 19 04:16:49 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:49 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5 Jun 19 04:16:49 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:50 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2" returned: 0 in 0.862s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea42bba2-b95e-4727-a50d-95912980e985(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:16:50 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4d4cfc-3293-4f65-aee8-2069159e7845]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:50 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985 Jun 19 04:16:50 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:50 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5" returned: 0 in 1.006s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:50 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5 Jun 19 04:16:50 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:50 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985" returned: 0 in 0.809s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:50 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 Jun 19 04:16:50 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:51 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5" returned: 0 in 0.709s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Lock "cinder-quobyte-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5" released by "delete_volume" :: held 1.777s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:51 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Created reservations ['f868d426-cc88-4171-8d33-025693014f46', '36d74c11-40e0-4a32-bda5-56f403dd5360', '5d0d9d61-6da1-4fc7-a776-489a00fc389c', 'a23ce7e4-e824-492b-8c9f-566ddea91bbf'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:51 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:16:51 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:51 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2" returned: 0 in 0.869s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:51 devstack sudo[99084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2 Jun 19 04:16:51 devstack sudo[99084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:52 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.964s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:52 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:16:52 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Deleted volume successfully. Jun 19 04:16:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-51e39475-a7e9-441c-b677-719aeaac6746 tempest-ServerRescueNegativeTestJSON-185148190 None] Lock "cinder-9f7c19d2-93f5-413c-8e37-1f6ef59fcdf5-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:52 devstack sudo[99084]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985.561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2" returned: 0 in 1.063s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-561e0ee3-fe4f-4e4c-8d74-b87aa07d9cc2" released by "_delete_snapshot" :: held 3.807s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-ea42bba2-b95e-4727-a50d-95912980e985" released by "delete_snapshot" :: held 3.844s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-fe614141-660d-48c7-9eeb-366066c00a35" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-fe614141-660d-48c7-9eeb-366066c00a35" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-6b30c655-2d9d-41db-b238-7ff1a8ac58cd" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-6b30c655-2d9d-41db-b238-7ff1a8ac58cd" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Deleting offline snapshot 6b30c655-2d9d-41db-b238-7ff1a8ac58cd of volume fe614141-660d-48c7-9eeb-366066c00a35 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:16:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] snapshot_file for this snap is: volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:16:53 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2c7bfd-761f-407b-a982-e93f0b29d659]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:53 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd Jun 19 04:16:53 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:54 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd" returned: 0 in 1.471s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe614141-660d-48c7-9eeb-366066c00a35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:16:54 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8c4d10-e538-409c-9c80-c0b67db2fd4e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:54 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35 Jun 19 04:16:54 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:55 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35" returned: 0 in 1.194s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:55 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd Jun 19 04:16:55 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:56 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd" returned: 0 in 0.736s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:56 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd Jun 19 04:16:56 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:57 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35.6b30c655-2d9d-41db-b238-7ff1a8ac58cd" returned: 0 in 0.645s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:57 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-6b30c655-2d9d-41db-b238-7ff1a8ac58cd" released by "_delete_snapshot" :: held 4.291s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:57 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-fe614141-660d-48c7-9eeb-366066c00a35" released by "delete_snapshot" :: held 4.331s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:57 devstack cinder-volume[93530]: WARNING cinder.quota [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1866993303 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1866993303, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:16:57 devstack cinder-volume[93530]: WARNING cinder.quota [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1866993303 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1866993303, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:16:57 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Created reservations ['dbee4b66-3d0a-4764-b3ea-5ed996519b2b', '62384e1c-189b-4cde-ae93-996341927506', 'dfa7baff-67d1-4223-8024-bea0c06f91dd', 'b4433a08-b698-4631-9161-7cc7b21884ad'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:57 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] Created reservations ['122ca4cf-4a91-403a-926f-0bd016a4bfa4', '63596050-1b84-4a03-b7d5-d0a28b4628a7', 'b107ddb7-bf8f-4604-9836-c4f414ffb78d', 'f8796dde-fe52-425a-81ad-395fb0fd7286'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:57 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-00866599-56f4-4e14-a2b7-018572e3e1e8 tempest-GroupSnapshotsTest-551423306 None] group_snapshot e4eae4a0-8414-4466-9227-4ffa3c60a327: deleted successfully Jun 19 04:16:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-ea42bba2-b95e-4727-a50d-95912980e985" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-ea42bba2-b95e-4727-a50d-95912980e985" acquired by "delete_volume" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:58 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[db21a84c-e2bd-4acc-bc3c-bce622bb0ba7]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:58 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985 Jun 19 04:16:58 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:16:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:58 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:16:58 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:59 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985" returned: 0 in 1.002s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:59 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985 Jun 19 04:16:59 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:59 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.792s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:00 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ea42bba2-b95e-4727-a50d-95912980e985" returned: 0 in 0.857s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-ea42bba2-b95e-4727-a50d-95912980e985" released by "delete_volume" :: held 1.933s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-fe614141-660d-48c7-9eeb-366066c00a35" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-fe614141-660d-48c7-9eeb-366066c00a35" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:00 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b6e40a-a127-4f40-bf42-7b848583546e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:00 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35 Jun 19 04:17:00 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:01 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35" returned: 0 in 1.021s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:01 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35 Jun 19 04:17:01 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:02 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-fe614141-660d-48c7-9eeb-366066c00a35" returned: 0 in 0.814s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-fe614141-660d-48c7-9eeb-366066c00a35" released by "delete_volume" :: held 2.014s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:02 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Created reservations ['7d1cf70d-9a6d-4f07-8881-d5d4dc2ec88b'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:02 devstack cinder-volume[93530]: WARNING cinder.quota [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1866993303 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1866993303, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:17:02 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Created reservations ['882b4be1-9bb6-490c-95e8-ee7fa939dd73', 'f2e18076-7fd5-4d0b-a52c-d9acdba40df1', '36f6fe25-dcd7-46b9-87e7-3a238d9e5f83', 'fbcce242-fc2c-45b0-87e3-427f7818ada0'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:02 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Created reservations ['8dd75ed6-67d0-4a34-a74c-94bcb5cf2e53', 'dbe49151-0cb5-4893-a6d3-27a756bcdfdb', '2004fda7-d2f4-41cf-930a-7991aa484adb', '45175201-8d8d-4907-838f-557837679405'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:03 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:17:03 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:03 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.786s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:03 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:03 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f67ccd50-abff-411b-971c-959d0eea7117 tempest-GroupSnapshotsTest-551423306 None] Delete group completed successfully. Jun 19 04:17:04 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-35005ac5-990a-48b2-8caa-4a5eff76bf9d tempest-GroupSnapshotsTest-551423306 None] Group tempest-GroupSnapshotsTest-Group-1144369441: creating Jun 19 04:17:04 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-35005ac5-990a-48b2-8caa-4a5eff76bf9d tempest-GroupSnapshotsTest-551423306 None] Group tempest-GroupSnapshotsTest-Group-1144369441: created successfully Jun 19 04:17:04 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-35005ac5-990a-48b2-8caa-4a5eff76bf9d tempest-GroupSnapshotsTest-551423306 None] Create group completed successfully. Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Flow 'volume_create_manager' (e41292c8-3e9b-483b-a3ad-2e1c48838013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c20038-187b-4e1f-bb21-7ae78d5f57d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c20038-187b-4e1f-bb21-7ae78d5f57d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1932243214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fe05479-3b77-464a-9849-458d45dc00e0,host='devstack@QuobyteHD#QuobyteHD',id=720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6eca1f2c1514cea9bc577af6b39feae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:06Z,use_quota=True,user_id='46afa46086d64b4d9af5153beccf418b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b194aac-477c-4c0d-a76c-0f456f3dce1f),volume_type_id=8b194aac-477c-4c0d-a76c-0f456f3dce1f)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7124abbf-1d26-4152-aae6-149700ace0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7124abbf-1d26-4152-aae6-149700ace0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32fc68e-2a22-4e24-b1b2-bbdb5f0d6b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32fc68e-2a22-4e24-b1b2-bbdb5f0d6b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43', 'volume_name': 'volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fb3234-a2a8-4141-831a-ccc8ad35f220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48fb3234-a2a8-4141-831a-ccc8ad35f220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0285f03-f6dc-4c71-ad5f-b607881606a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:05 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Volume 720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43', 'volume_size': 1} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6fe05479-3b77-464a-9849-458d45dc00e0,created_at=2026-06-19T02:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1932243214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fe05479-3b77-464a-9849-458d45dc00e0,host='devstack@QuobyteHD#QuobyteHD',id=720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6eca1f2c1514cea9bc577af6b39feae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:06Z,use_quota=True,user_id='46afa46086d64b4d9af5153beccf418b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b194aac-477c-4c0d-a76c-0f456f3dce1f),volume_type_id=8b194aac-477c-4c0d-a76c-0f456f3dce1f)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Creating volume 720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:05 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:17:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:05 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 1073741824 Jun 19 04:17:05 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:06 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 1073741824" returned: 0 in 0.947s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:06 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 Jun 19 04:17:06 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:07 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43" returned: 0 in 0.757s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0285f03-f6dc-4c71-ad5f-b607881606a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d9a073-5349-4d25-9ac0-c48e5fc1d63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:07 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Volume volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 (720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43): created successfully Jun 19 04:17:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d9a073-5349-4d25-9ac0-c48e5fc1d63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Flow 'volume_create_manager' (e41292c8-3e9b-483b-a3ad-2e1c48838013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:07 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-075399de-aaec-483d-b783-4a7f8d82051d tempest-GroupSnapshotsTest-551423306 None] Created volume successfully. Jun 19 04:17:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Acquiring lock "cinder-8a8003b2-ecdc-4f24-a811-e16704f74c6a-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Lock "cinder-8a8003b2-ecdc-4f24-a811-e16704f74c6a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Acquiring lock "cinder-quobyte-8a8003b2-ecdc-4f24-a811-e16704f74c6a" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Lock "cinder-quobyte-8a8003b2-ecdc-4f24-a811-e16704f74c6a" acquired by "delete_volume" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:08 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fffed00-6791-4c43-b386-9958fee82d3e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:08 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] GroupSnapshot dc24b279-50f4-4db0-840f-add212fada5c: creating. Jun 19 04:17:08 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] Group snapshot dc24b279-50f4-4db0-840f-add212fada5c: creating. {{(pid=93530) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 19 04:17:08 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a Jun 19 04:17:08 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] Creating offline snapshot f77dc2a7-5cb2-4035-a680-6cf2ed20d572 of volume 720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:17:08 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[17313c69-23c6-4100-ae35-3245312e1b32]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:08 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 Jun 19 04:17:08 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:09 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a" returned: 0 in 0.884s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:09 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a Jun 19 04:17:09 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:09 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43" returned: 0 in 0.859s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:09 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 1G Jun 19 04:17:09 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:09 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-2c0f99a5-3871-40c7-ae45-e74721484b99 req-4fd1e7d5-0fa3-44d5-b6b0-2d37c43f723e tempest-ServerActionsTestOtherA-1552187486 None] Terminate volume connection completed successfully. Jun 19 04:17:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-2c0f99a5-3871-40c7-ae45-e74721484b99 req-4fd1e7d5-0fa3-44d5-b6b0-2d37c43f723e tempest-ServerActionsTestOtherA-1552187486 None] Deleting attachment 02ff5300-932d-43ae-9bb9-54f98ea0dd77. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:17:10 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a8003b2-ecdc-4f24-a811-e16704f74c6a" returned: 0 in 0.839s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Lock "cinder-quobyte-8a8003b2-ecdc-4f24-a811-e16704f74c6a" released by "delete_volume" :: held 1.780s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:10 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Created reservations ['e7647ec0-462b-4206-acd3-e779b3bc048a', '8c9e752e-c0fe-41ee-8641-d5291f9194d7', 'a11ed778-8372-405a-ba5c-e92baf6b4203', 'f2b6e605-76de-4a8f-a5b6-16965a3f8e47'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:10 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:17:10 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:10 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 1G" returned: 0 in 0.994s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:10 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 Jun 19 04:17:10 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:11 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.736s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:11 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:11 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Deleted volume successfully. Jun 19 04:17:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a1094494-923d-4e30-b998-f7fa8eaacd27 tempest-AttachVolumeShelveTestJSON-1818868376 None] Lock "cinder-8a8003b2-ecdc-4f24-a811-e16704f74c6a-delete_volume" released by "delete_volume" :: held 2.778s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:11 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572" returned: 0 in 0.879s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:11 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:17:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:11 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 Jun 19 04:17:11 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:12 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572" returned: 0 in 0.772s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:12 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.info Jun 19 04:17:12 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:13 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.info" returned: 0 in 1.060s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:13 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:17:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:13 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.info Jun 19 04:17:13 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:14 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.info" returned: 0 in 0.932s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.637s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:14 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-bfce15ea-c85f-4d2d-a66b-339edf310b2a tempest-GroupSnapshotsTest-551423306 None] group_snapshot dc24b279-50f4-4db0-840f-add212fada5c: created successfully Jun 19 04:17:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] group_snapshot dc24b279-50f4-4db0-840f-add212fada5c: deleting Jun 19 04:17:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] group_snapshot dc24b279-50f4-4db0-840f-add212fada5c: deleting {{(pid=93530) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 19 04:17:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-f77dc2a7-5cb2-4035-a680-6cf2ed20d572" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-f77dc2a7-5cb2-4035-a680-6cf2ed20d572" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Deleting offline snapshot f77dc2a7-5cb2-4035-a680-6cf2ed20d572 of volume 720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:17:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] snapshot_file for this snap is: volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:17:15 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[950cc62a-4fdc-4df1-92b1-6c57d4b3fa44]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:15 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 Jun 19 04:17:15 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:16 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572" returned: 0 in 1.157s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:17:16 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb8e561-29f8-49e1-8cd0-5457df1fa56d]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:16 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 Jun 19 04:17:16 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:17 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43" returned: 0 in 0.911s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:17 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 Jun 19 04:17:17 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:18 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572" returned: 0 in 0.923s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:18 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572 Jun 19 04:17:18 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:19 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43.f77dc2a7-5cb2-4035-a680-6cf2ed20d572" returned: 0 in 0.787s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-f77dc2a7-5cb2-4035-a680-6cf2ed20d572" released by "_delete_snapshot" :: held 3.921s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43" released by "delete_snapshot" :: held 3.982s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Flow 'volume_create_manager' (ddd579f6-4ba4-4f7d-987f-745fd144149a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f1c28c-788b-43f0-95c6-68c3be3e7b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f1c28c-788b-43f0-95c6-68c3be3e7b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-477850411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6cfe64-e232-45e4-80c6-4bb48515a3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c0b0322f284bcf91042dda268b43db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:19Z,use_quota=True,user_id='c7c94d89220041dcb9660b87a1d1e965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0949fd03-edec-4d69-8b38-59fb16b466f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0949fd03-edec-4d69-8b38-59fb16b466f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd0acfc-1198-472c-9048-a81b2b7ef3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd0acfc-1198-472c-9048-a81b2b7ef3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d6cfe64-e232-45e4-80c6-4bb48515a3c5', 'volume_name': 'volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72c60f5-cfca-4626-a6d4-109634375e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72c60f5-cfca-4626-a6d4-109634375e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e4d710-f6c2-47bc-94ef-abb036bdd969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:19 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Volume 9d6cfe64-e232-45e4-80c6-4bb48515a3c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5', 'volume_size': 1} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-477850411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6cfe64-e232-45e4-80c6-4bb48515a3c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c0b0322f284bcf91042dda268b43db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:19Z,use_quota=True,user_id='c7c94d89220041dcb9660b87a1d1e965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Creating volume 9d6cfe64-e232-45e4-80c6-4bb48515a3c5 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:19 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:19 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 1073741824 Jun 19 04:17:19 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:19 devstack cinder-volume[93530]: WARNING cinder.quota [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-318184135 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-318184135, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:17:19 devstack cinder-volume[93530]: WARNING cinder.quota [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-318184135 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-318184135, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:17:19 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] Created reservations ['3d42de56-c4e2-4d4f-86a7-106e1b10c501', '2a3ac097-aebb-4037-a919-d376f6079959', '90f77c4f-db3e-4646-97e3-5da7975f6746', 'e207110b-3cb7-45b1-967d-9e5b708b5456'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:19 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-146ff25f-01b0-4aea-9510-bd1de36cc564 tempest-GroupSnapshotsTest-551423306 None] group_snapshot dc24b279-50f4-4db0-840f-add212fada5c: deleted successfully Jun 19 04:17:20 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=83,cinder:SELECT=74,cinder:INSERT=20,cinder:DELETE=4 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:17:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "cinder-quobyte-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:20 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ef4ddc-2d3b-4053-9dfe-9e8ae7b00227]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:20 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 Jun 19 04:17:20 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:20 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 1073741824" returned: 0 in 1.361s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Acquiring lock "cinder-727b4c25-face-4843-9ae0-e127b2a760e3-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Lock "cinder-727b4c25-face-4843-9ae0-e127b2a760e3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:20 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 Jun 19 04:17:20 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Acquiring lock "cinder-quobyte-727b4c25-face-4843-9ae0-e127b2a760e3" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Lock "cinder-quobyte-727b4c25-face-4843-9ae0-e127b2a760e3" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:21 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2908b5-1971-4453-9d11-f28a04b42349]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:21 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3 Jun 19 04:17:21 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:21 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43" returned: 0 in 0.965s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:21 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43 Jun 19 04:17:21 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:21 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5" returned: 0 in 0.893s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] <== create_volume: return (2344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.349s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e4d710-f6c2-47bc-94ef-abb036bdd969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be52e756-f59c-457d-8fb3-1122e6340e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:21 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Volume volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 (9d6cfe64-e232-45e4-80c6-4bb48515a3c5): created successfully Jun 19 04:17:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be52e756-f59c-457d-8fb3-1122e6340e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Flow 'volume_create_manager' (ddd579f6-4ba4-4f7d-987f-745fd144149a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:21 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-8d9bca9c-2b9a-4bdf-9ffe-5b6ce5e1ef08 req-58835e60-ff48-43ef-a07d-8f08636ef68e tempest-VolumesSnapshotsTestJSON-72761953 None] Created volume successfully. Jun 19 04:17:21 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3" returned: 0 in 0.922s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:22 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3 Jun 19 04:17:22 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:22 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43" returned: 0 in 0.842s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Lock "cinder-quobyte-720a8b1b-e8ef-4485-85f0-d4e5a3fa7e43" released by "delete_volume" :: held 1.937s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=71,cinder:SELECT=80,cinder:INSERT=16,cinder:DELETE=3 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Created reservations ['a8b737f6-fc17-4153-b17f-f6b5269add23'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:22 devstack cinder-volume[93530]: WARNING cinder.quota [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-318184135 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-318184135, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Created reservations ['c0c79db7-4697-4221-b2c5-3307d0266ee7', '2b25deb5-2108-4629-a71d-8649d130af1b', '539e0921-ce89-422b-bc8c-5cba27339afc', 'f4b85b52-0e93-4877-97dc-126bc60a005c'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:22 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:17:22 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:22 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-727b4c25-face-4843-9ae0-e127b2a760e3" returned: 0 in 0.803s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Lock "cinder-quobyte-727b4c25-face-4843-9ae0-e127b2a760e3" released by "delete_volume" :: held 1.799s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Created reservations ['b029de7b-9478-417b-a507-efd82d210cad', '1d760c00-3619-403e-8f0e-0f38185dbbba', '08651f06-55ae-45a8-855e-e87825ad62fd', '6ed9ea4b-919f-4ab4-8b6f-0b492dc146a7'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] Creating offline snapshot 92163246-8df0-437a-a187-7bc4b1a6bffe of volume 9d6cfe64-e232-45e4-80c6-4bb48515a3c5 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:17:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:23 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e10ad0d-45d7-47c7-81c2-ed7474008d65]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:23 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:17:23 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:23 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 Jun 19 04:17:23 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:23 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.256s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:23 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:23 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-84b7a1c1-562d-454c-a16e-a09e6c1bf959 tempest-GroupSnapshotsTest-551423306 None] Delete group completed successfully. Jun 19 04:17:24 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.183s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:24 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:24 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Deleted volume successfully. Jun 19 04:17:24 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ecb5d25a-a258-4408-ba44-205fd19b409c tempest-ServerActionsTestOtherA-1552187486 None] Lock "cinder-727b4c25-face-4843-9ae0-e127b2a760e3-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:24 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5" returned: 0 in 1.224s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:24 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe 1G Jun 19 04:17:24 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:25 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe 1G" returned: 0 in 1.134s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:25 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe Jun 19 04:17:25 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:26 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe" returned: 0 in 1.008s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:26 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe is being set with open permissions: ugo+rw Jun 19 04:17:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:26 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe Jun 19 04:17:26 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:27 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe" returned: 0 in 0.943s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:27 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.info Jun 19 04:17:27 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:28 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.info" returned: 0 in 0.930s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:28 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.info is being set with open permissions: ugo+rw Jun 19 04:17:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:28 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.info Jun 19 04:17:28 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:29 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.info" returned: 0 in 0.897s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.307s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:29 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-35b89126-fa17-43b7-aae9-cee3a9a85610 req-ad2fc0bf-7822-441d-acaa-a718e9efe237 tempest-VolumesSnapshotsTestJSON-72761953 None] Create snapshot completed successfully Jun 19 04:17:29 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Acquiring lock "cinder-92163246-8df0-437a-a187-7bc4b1a6bffe-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:29 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "cinder-92163246-8df0-437a-a187-7bc4b1a6bffe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:29 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Acquiring lock "cinder-quobyte-9d6cfe64-e232-45e4-80c6-4bb48515a3c5" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:29 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "cinder-quobyte-9d6cfe64-e232-45e4-80c6-4bb48515a3c5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:29 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Acquiring lock "cinder-quobyte-92163246-8df0-437a-a187-7bc4b1a6bffe" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:29 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "cinder-quobyte-92163246-8df0-437a-a187-7bc4b1a6bffe" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Deleting offline snapshot 92163246-8df0-437a-a187-7bc4b1a6bffe of volume 9d6cfe64-e232-45e4-80c6-4bb48515a3c5 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:17:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] snapshot_file for this snap is: volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:17:29 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[9037d190-0217-46cc-b612-e95bb850e5cc]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:30 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe Jun 19 04:17:30 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:31 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe" returned: 0 in 1.097s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:17:31 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[4332a6a0-eecc-4195-8cf2-54eea4a510c4]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:31 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 Jun 19 04:17:31 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:32 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5" returned: 0 in 1.209s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:32 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe Jun 19 04:17:32 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:33 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe" returned: 0 in 0.997s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:33 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe Jun 19 04:17:33 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:34 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5.92163246-8df0-437a-a187-7bc4b1a6bffe" returned: 0 in 0.998s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:34 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "cinder-quobyte-92163246-8df0-437a-a187-7bc4b1a6bffe" released by "_delete_snapshot" :: held 4.472s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:34 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "cinder-quobyte-9d6cfe64-e232-45e4-80c6-4bb48515a3c5" released by "delete_snapshot" :: held 4.513s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:34 devstack cinder-volume[93530]: WARNING cinder.quota [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:17:34 devstack cinder-volume[93530]: DEBUG cinder.quota [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Created reservations ['763a297e-af3c-4e9f-ad8a-932ffb605d9e', '69882f62-51c2-441e-8a2e-975b43e272cc', '27ef3dda-3d90-4946-8204-32dd8d3b36a3', 'c30155ea-0b50-4445-bac3-6a18f9b9bc2e'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:34 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Delete snapshot completed successfully. Jun 19 04:17:34 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-2976b2ea-f15b-4ff4-8d3f-7686eb05ded8 req-2d3c4db9-178e-478f-96de-ffff0cf273d8 tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "cinder-92163246-8df0-437a-a187-7bc4b1a6bffe-delete_snapshot" released by "delete_snapshot" :: held 4.760s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Acquiring lock "cinder-9d6cfe64-e232-45e4-80c6-4bb48515a3c5-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "cinder-9d6cfe64-e232-45e4-80c6-4bb48515a3c5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Acquiring lock "cinder-quobyte-9d6cfe64-e232-45e4-80c6-4bb48515a3c5" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "cinder-quobyte-9d6cfe64-e232-45e4-80c6-4bb48515a3c5" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:35 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab58de0-5652-4f79-b019-8a04d1e701cf]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:35 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 Jun 19 04:17:35 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:36 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5" returned: 0 in 0.967s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:36 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5 Jun 19 04:17:36 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:37 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9d6cfe64-e232-45e4-80c6-4bb48515a3c5" returned: 0 in 0.949s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:37 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "cinder-quobyte-9d6cfe64-e232-45e4-80c6-4bb48515a3c5" released by "delete_volume" :: held 2.023s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:37 devstack cinder-volume[93530]: DEBUG cinder.quota [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Created reservations ['ac65e1ed-12db-434a-ac22-679bc7921387', 'b222ea43-8ef1-405d-9582-5196dac42247', '3638423a-87c6-406f-83e6-a0971b0614ad', '1c89ff1d-d9d3-47c0-9c9f-be35a865ee42'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:37 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:17:37 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:38 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.037s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:38 devstack cinder-volume[93530]: DEBUG cinder.manager [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:38 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Deleted volume successfully. Jun 19 04:17:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-71749549-5817-4561-a4ef-87c9731a4279 req-717d2235-3e23-4035-829d-088f0904dce7 tempest-VolumesSnapshotsTestJSON-72761953 None] Lock "cinder-9d6cfe64-e232-45e4-80c6-4bb48515a3c5-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:43 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Flow 'volume_create_manager' (93c673e7-1842-4200-acbc-f61cfbd4c2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212487b9-983d-449a-9422-49e2d7dea2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212487b9-983d-449a-9422-49e2d7dea2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1419053275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4280e5-4f9a-45c2-b61e-8b8079827721,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d3af50b295e4535a724435fcb800aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:44Z,use_quota=True,user_id='b5610ccc86fc491690ddbf53cfd60028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1181729b-cc71-469b-9531-372989c3b386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1181729b-cc71-469b-9531-372989c3b386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20e9de0-ac25-4141-89d3-b02f8a3e7aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20e9de0-ac25-4141-89d3-b02f8a3e7aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b4280e5-4f9a-45c2-b61e-8b8079827721', 'volume_name': 'volume-0b4280e5-4f9a-45c2-b61e-8b8079827721', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca8bf0d-1673-4b76-9ae6-d4a492b9c476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca8bf0d-1673-4b76-9ae6-d4a492b9c476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ee7540-5a7d-4e50-9ddb-ba1652358897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:44 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Volume 0b4280e5-4f9a-45c2-b61e-8b8079827721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b4280e5-4f9a-45c2-b61e-8b8079827721', 'volume_size': 1} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1419053275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b4280e5-4f9a-45c2-b61e-8b8079827721,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d3af50b295e4535a724435fcb800aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:44Z,use_quota=True,user_id='b5610ccc86fc491690ddbf53cfd60028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Creating volume 0b4280e5-4f9a-45c2-b61e-8b8079827721 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:44 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:17:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0b4280e5-4f9a-45c2-b61e-8b8079827721 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:44 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0b4280e5-4f9a-45c2-b61e-8b8079827721 1073741824 Jun 19 04:17:44 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:44 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-cdc4813e-dea5-4a73-81dd-3415a8bf0ebf tempest-GroupsTest-1081966816 None] Group tempest-Group1-1026851169: creating Jun 19 04:17:44 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-cdc4813e-dea5-4a73-81dd-3415a8bf0ebf tempest-GroupsTest-1081966816 None] Group tempest-Group1-1026851169: created successfully Jun 19 04:17:44 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-cdc4813e-dea5-4a73-81dd-3415a8bf0ebf tempest-GroupsTest-1081966816 None] Create group completed successfully. Jun 19 04:17:45 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0b4280e5-4f9a-45c2-b61e-8b8079827721 1073741824" returned: 0 in 1.266s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0b4280e5-4f9a-45c2-b61e-8b8079827721 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:45 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0b4280e5-4f9a-45c2-b61e-8b8079827721 Jun 19 04:17:45 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:45 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-12a17ae6-c837-491a-95c1-18a26130ec21 tempest-GroupsTest-1081966816 None] Group tempest-Group2-329052882: creating Jun 19 04:17:46 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-12a17ae6-c837-491a-95c1-18a26130ec21 tempest-GroupsTest-1081966816 None] Group tempest-Group2-329052882: created successfully Jun 19 04:17:46 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-12a17ae6-c837-491a-95c1-18a26130ec21 tempest-GroupsTest-1081966816 None] Create group completed successfully. Jun 19 04:17:46 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0b4280e5-4f9a-45c2-b61e-8b8079827721" returned: 0 in 0.787s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68ee7540-5a7d-4e50-9ddb-ba1652358897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b4280e5-4f9a-45c2-b61e-8b8079827721', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aca786b-4e42-4c04-b151-7f3cb8417489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:46 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Volume volume-0b4280e5-4f9a-45c2-b61e-8b8079827721 (0b4280e5-4f9a-45c2-b61e-8b8079827721): created successfully Jun 19 04:17:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aca786b-4e42-4c04-b151-7f3cb8417489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Flow 'volume_create_manager' (93c673e7-1842-4200-acbc-f61cfbd4c2aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:46 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-cb005877-e5c8-44ea-bd88-e341c2cdd0e3 tempest-VolumesTestJSON-244838430 None] Created volume successfully. Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Flow 'volume_create_manager' (d6ffb09f-d846-4a4c-8f5a-08b4170d0b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8717493a-38d7-4163-b3bf-cb80389baee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8717493a-38d7-4163-b3bf-cb80389baee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-397732192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5ca74032-1ce9-4a29-9cff-3feebc05af2a,host='devstack@QuobyteHD#QuobyteHD',id=b1765570-730e-4691-8bcc-4b1add3e347b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890b2256f2104de49cc1317ec3f68948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:48Z,use_quota=True,user_id='69a60787c21546bca376035d68278827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc5071d2-8d7a-4697-afdf-649af494fd06),volume_type_id=cc5071d2-8d7a-4697-afdf-649af494fd06)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b34174-865a-4926-a84b-6bdbabc3de5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b34174-865a-4926-a84b-6bdbabc3de5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c9c9a6-725d-4969-af29-0b3ebb2b145c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c9c9a6-725d-4969-af29-0b3ebb2b145c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1765570-730e-4691-8bcc-4b1add3e347b', 'volume_name': 'volume-b1765570-730e-4691-8bcc-4b1add3e347b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9de6a7-eb0b-4860-861f-8e7ca8f98c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb9de6a7-eb0b-4860-861f-8e7ca8f98c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef885de4-a8b8-4a42-9d97-2c40ee73db73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:47 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Volume b1765570-730e-4691-8bcc-4b1add3e347b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1765570-730e-4691-8bcc-4b1add3e347b', 'volume_size': 1} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5ca74032-1ce9-4a29-9cff-3feebc05af2a,created_at=2026-06-19T02:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-397732192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5ca74032-1ce9-4a29-9cff-3feebc05af2a,host='devstack@QuobyteHD#QuobyteHD',id=b1765570-730e-4691-8bcc-4b1add3e347b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890b2256f2104de49cc1317ec3f68948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:48Z,use_quota=True,user_id='69a60787c21546bca376035d68278827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc5071d2-8d7a-4697-afdf-649af494fd06),volume_type_id=cc5071d2-8d7a-4697-afdf-649af494fd06)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Creating volume b1765570-730e-4691-8bcc-4b1add3e347b {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:47 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:17:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b1765570-730e-4691-8bcc-4b1add3e347b 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:48 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b1765570-730e-4691-8bcc-4b1add3e347b 1073741824 Jun 19 04:17:48 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:48 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Flow 'volume_create_manager' (de42eaca-4dba-4c4c-a66b-c7a4588706db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ca33bb-b1e8-440d-af57-76fb61023c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79ca33bb-b1e8-440d-af57-76fb61023c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-317361328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d3af50b295e4535a724435fcb800aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:48Z,use_quota=True,user_id='b5610ccc86fc491690ddbf53cfd60028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2de4225-459c-45e8-b391-f309f476705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2de4225-459c-45e8-b391-f309f476705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f0d0c4-44d1-4301-a23d-48fecb5aa36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f0d0c4-44d1-4301-a23d-48fecb5aa36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0', 'volume_name': 'volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa0a841-f9f1-4008-a049-c6412517d12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa0a841-f9f1-4008-a049-c6412517d12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a64ab17-92d5-48f6-988b-062f81e1f47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:48 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Volume 0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0', 'volume_size': 1} Jun 19 04:17:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:48 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b1765570-730e-4691-8bcc-4b1add3e347b 1073741824" returned: 0 in 0.886s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b1765570-730e-4691-8bcc-4b1add3e347b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:48 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b1765570-730e-4691-8bcc-4b1add3e347b Jun 19 04:17:48 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:49 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b1765570-730e-4691-8bcc-4b1add3e347b" returned: 0 in 0.760s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.468s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-317361328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d3af50b295e4535a724435fcb800aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:48Z,use_quota=True,user_id='b5610ccc86fc491690ddbf53cfd60028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Creating volume 0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:49 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:49 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0 1073741824 Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef885de4-a8b8-4a42-9d97-2c40ee73db73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1765570-730e-4691-8bcc-4b1add3e347b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:49 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec10fd5-d1ce-44e1-9ce2-4ebe56b12ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:49 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Volume volume-b1765570-730e-4691-8bcc-4b1add3e347b (b1765570-730e-4691-8bcc-4b1add3e347b): created successfully Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec10fd5-d1ce-44e1-9ce2-4ebe56b12ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Flow 'volume_create_manager' (d6ffb09f-d846-4a4c-8f5a-08b4170d0b63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:49 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ccfa0888-0291-445a-b5ce-2d11b935eeec tempest-GroupsTest-1081966816 None] Created volume successfully. Jun 19 04:17:50 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0 1073741824" returned: 0 in 1.074s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:50 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0 Jun 19 04:17:50 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Acquiring lock "cinder-quobyte-b1765570-730e-4691-8bcc-4b1add3e347b" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Lock "cinder-quobyte-b1765570-730e-4691-8bcc-4b1add3e347b" acquired by "delete_volume" :: waited 0.051s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:51 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa286470-e90a-4a50-8144-ad8b9578835e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b1765570-730e-4691-8bcc-4b1add3e347b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:51 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b1765570-730e-4691-8bcc-4b1add3e347b Jun 19 04:17:51 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:51 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0" returned: 0 in 0.832s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] <== create_volume: return (1955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a64ab17-92d5-48f6-988b-062f81e1f47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559a83f6-a255-4f70-90f1-385c1fdcc038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:51 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Volume volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0 (0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0): created successfully Jun 19 04:17:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559a83f6-a255-4f70-90f1-385c1fdcc038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Flow 'volume_create_manager' (de42eaca-4dba-4c4c-a66b-c7a4588706db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:51 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-0be78cc2-adf1-4da8-80b3-b10db1a8ef86 tempest-VolumesTestJSON-244838430 None] Created volume successfully. Jun 19 04:17:52 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b1765570-730e-4691-8bcc-4b1add3e347b" returned: 0 in 0.961s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b1765570-730e-4691-8bcc-4b1add3e347b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:52 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b1765570-730e-4691-8bcc-4b1add3e347b Jun 19 04:17:52 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:53 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b1765570-730e-4691-8bcc-4b1add3e347b" returned: 0 in 1.137s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Lock "cinder-quobyte-b1765570-730e-4691-8bcc-4b1add3e347b" released by "delete_volume" :: held 2.180s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Flow 'volume_create_manager' (732f3fc8-0b81-406f-9295-29a16f3a68fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34543c52-c47d-4c8a-96fa-c5dacff4ff0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Created reservations ['88b0fadc-dda9-4ae8-99c8-e3143a85b4af'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34543c52-c47d-4c8a-96fa-c5dacff4ff0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-989276516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9047559-fb4a-4fc5-8cef-724a05c199c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d3af50b295e4535a724435fcb800aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:53Z,use_quota=True,user_id='b5610ccc86fc491690ddbf53cfd60028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe927e1-2bd8-4c6e-b5a7-951f0603147f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe927e1-2bd8-4c6e-b5a7-951f0603147f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d5dac2-2e72-4990-9c40-882caf91f19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d5dac2-2e72-4990-9c40-882caf91f19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9047559-fb4a-4fc5-8cef-724a05c199c3', 'volume_name': 'volume-b9047559-fb4a-4fc5-8cef-724a05c199c3', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e62e61-8198-47db-9eef-c486b61c459f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0e62e61-8198-47db-9eef-c486b61c459f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b323cc71-adf6-4124-9a57-771c6c97b754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:53 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Volume b9047559-fb4a-4fc5-8cef-724a05c199c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9047559-fb4a-4fc5-8cef-724a05c199c3', 'volume_size': 1} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-989276516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9047559-fb4a-4fc5-8cef-724a05c199c3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0d3af50b295e4535a724435fcb800aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:53Z,use_quota=True,user_id='b5610ccc86fc491690ddbf53cfd60028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Creating volume b9047559-fb4a-4fc5-8cef-724a05c199c3 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:53 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b9047559-fb4a-4fc5-8cef-724a05c199c3 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:53 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b9047559-fb4a-4fc5-8cef-724a05c199c3 1073741824 Jun 19 04:17:53 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:53 devstack cinder-volume[93530]: WARNING cinder.quota [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1689758815 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1689758815, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:17:53 devstack cinder-volume[93530]: WARNING cinder.quota [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1689758815 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1689758815, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:17:53 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Created reservations ['285a7bd0-3174-4cff-9027-2ae083d8274e', 'c4c31464-b5a1-4830-9097-bb28b8b22792', 'd3a2e39f-7c80-4ffd-98f1-26cb3999bd0f', 'ae5e72fe-7a2b-47bf-9638-16302823a57e'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:54 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:17:54 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:55 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b9047559-fb4a-4fc5-8cef-724a05c199c3 1073741824" returned: 0 in 1.659s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:55 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-359282fc-3e89-4d67-b680-264078e217e7 tempest-GroupsTest-1081966816 None] Created reservations ['6b393f8b-056f-424b-b9bc-27ad79623221'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b9047559-fb4a-4fc5-8cef-724a05c199c3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:55 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b9047559-fb4a-4fc5-8cef-724a05c199c3 Jun 19 04:17:55 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-359282fc-3e89-4d67-b680-264078e217e7 tempest-GroupsTest-1081966816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-359282fc-3e89-4d67-b680-264078e217e7 tempest-GroupsTest-1081966816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-359282fc-3e89-4d67-b680-264078e217e7 tempest-GroupsTest-1081966816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-359282fc-3e89-4d67-b680-264078e217e7 tempest-GroupsTest-1081966816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-359282fc-3e89-4d67-b680-264078e217e7 tempest-GroupsTest-1081966816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-359282fc-3e89-4d67-b680-264078e217e7 tempest-GroupsTest-1081966816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:55 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:17:55 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:55 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.412s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:55 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:55 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-bd197a8d-18fe-48b0-b1cc-190911fb0616 tempest-GroupsTest-1081966816 None] Delete group completed successfully. Jun 19 04:17:56 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b9047559-fb4a-4fc5-8cef-724a05c199c3" returned: 0 in 1.345s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] <== create_volume: return (3097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.102s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b323cc71-adf6-4124-9a57-771c6c97b754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9047559-fb4a-4fc5-8cef-724a05c199c3', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fd22e6-73ad-4cf1-af5e-b2d85a4400f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:56 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-359282fc-3e89-4d67-b680-264078e217e7 tempest-GroupsTest-1081966816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.290s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:56 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-359282fc-3e89-4d67-b680-264078e217e7 tempest-GroupsTest-1081966816 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:56 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-359282fc-3e89-4d67-b680-264078e217e7 tempest-GroupsTest-1081966816 None] Delete group completed successfully. Jun 19 04:17:56 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Volume volume-b9047559-fb4a-4fc5-8cef-724a05c199c3 (b9047559-fb4a-4fc5-8cef-724a05c199c3): created successfully Jun 19 04:17:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fd22e6-73ad-4cf1-af5e-b2d85a4400f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Flow 'volume_create_manager' (732f3fc8-0b81-406f-9295-29a16f3a68fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:57 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-2a84dfa8-014e-4b1b-9d47-87e36581cb2c tempest-VolumesTestJSON-244838430 None] Created volume successfully. Jun 19 04:17:57 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-602a39d8-3058-414e-b011-93884608eddd tempest-GroupsTest-1081966816 None] Group tempest-GroupsTest-Group-673509354: creating Jun 19 04:17:57 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-602a39d8-3058-414e-b011-93884608eddd tempest-GroupsTest-1081966816 None] Group tempest-GroupsTest-Group-673509354: created successfully Jun 19 04:17:57 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-602a39d8-3058-414e-b011-93884608eddd tempest-GroupsTest-1081966816 None] Create group completed successfully. Jun 19 04:17:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:17:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 8 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:17:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:17:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Acquiring lock "cinder-b9047559-fb4a-4fc5-8cef-724a05c199c3-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Lock "cinder-b9047559-fb4a-4fc5-8cef-724a05c199c3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Acquiring lock "cinder-quobyte-b9047559-fb4a-4fc5-8cef-724a05c199c3" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Lock "cinder-quobyte-b9047559-fb4a-4fc5-8cef-724a05c199c3" acquired by "delete_volume" :: waited 0.025s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:59 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c53e48-7238-4e7b-82c0-f142d5a5758c]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b9047559-fb4a-4fc5-8cef-724a05c199c3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:59 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b9047559-fb4a-4fc5-8cef-724a05c199c3 Jun 19 04:17:59 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Flow 'volume_create_manager' (c7914f65-ceb3-4a55-82b9-9f6023e1d900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1e6928-867b-458e-be2a-d0c9a7aa6dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b1e6928-867b-458e-be2a-d0c9a7aa6dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-372565029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ee3e42f-8799-47e6-9137-30b5a8f42c6c,host='devstack@QuobyteHD#QuobyteHD',id=61eeee6e-8220-4dae-988e-859160da3c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890b2256f2104de49cc1317ec3f68948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:00Z,use_quota=True,user_id='69a60787c21546bca376035d68278827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9add9487-abf5-40fb-8a45-2a9ebb8be4eb),volume_type_id=9add9487-abf5-40fb-8a45-2a9ebb8be4eb)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7f54cc-da0a-433d-81e4-66b37c533bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7f54cc-da0a-433d-81e4-66b37c533bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba91846-3a15-428b-aeb3-a987a8e54c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba91846-3a15-428b-aeb3-a987a8e54c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61eeee6e-8220-4dae-988e-859160da3c0a', 'volume_name': 'volume-61eeee6e-8220-4dae-988e-859160da3c0a', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15193d80-7ca2-4226-a4e5-eb3e222ec55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15193d80-7ca2-4226-a4e5-eb3e222ec55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f2fb08-0213-4866-9d30-d0cf7ea39f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:00 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Volume 61eeee6e-8220-4dae-988e-859160da3c0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61eeee6e-8220-4dae-988e-859160da3c0a', 'volume_size': 1} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9ee3e42f-8799-47e6-9137-30b5a8f42c6c,created_at=2026-06-19T02:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-372565029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ee3e42f-8799-47e6-9137-30b5a8f42c6c,host='devstack@QuobyteHD#QuobyteHD',id=61eeee6e-8220-4dae-988e-859160da3c0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890b2256f2104de49cc1317ec3f68948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:00Z,use_quota=True,user_id='69a60787c21546bca376035d68278827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9add9487-abf5-40fb-8a45-2a9ebb8be4eb),volume_type_id=9add9487-abf5-40fb-8a45-2a9ebb8be4eb)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Creating volume 61eeee6e-8220-4dae-988e-859160da3c0a {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:00 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:18:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-61eeee6e-8220-4dae-988e-859160da3c0a 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:00 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-61eeee6e-8220-4dae-988e-859160da3c0a 1073741824 Jun 19 04:18:00 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:01 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b9047559-fb4a-4fc5-8cef-724a05c199c3" returned: 0 in 1.480s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b9047559-fb4a-4fc5-8cef-724a05c199c3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:01 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b9047559-fb4a-4fc5-8cef-724a05c199c3 Jun 19 04:18:01 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:01 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-61eeee6e-8220-4dae-988e-859160da3c0a 1073741824" returned: 0 in 1.604s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-61eeee6e-8220-4dae-988e-859160da3c0a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:01 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-61eeee6e-8220-4dae-988e-859160da3c0a Jun 19 04:18:01 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:02 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b9047559-fb4a-4fc5-8cef-724a05c199c3" returned: 0 in 0.962s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Lock "cinder-quobyte-b9047559-fb4a-4fc5-8cef-724a05c199c3" released by "delete_volume" :: held 2.521s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Created reservations ['a17ba2f6-79d0-4195-b4b0-0203ec6c658a', '91207c8a-cf89-4aeb-95f8-17bf032010ed', 'bd8c07d9-4eac-4c2b-80bc-7149615de6d6', 'af3e337a-9bc9-4f02-ac38-c7cd087227e2'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:02 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:18:02 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:02 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-61eeee6e-8220-4dae-988e-859160da3c0a" returned: 0 in 0.915s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] <== create_volume: return (2600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.603s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f2fb08-0213-4866-9d30-d0cf7ea39f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61eeee6e-8220-4dae-988e-859160da3c0a', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c14d954-3c11-4cb4-bc78-d4a1ee27ddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:02 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Volume volume-61eeee6e-8220-4dae-988e-859160da3c0a (61eeee6e-8220-4dae-988e-859160da3c0a): created successfully Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c14d954-3c11-4cb4-bc78-d4a1ee27ddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Flow 'volume_create_manager' (c7914f65-ceb3-4a55-82b9-9f6023e1d900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:02 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-18c142bc-2b62-411e-ad7a-66b370f26cd9 tempest-GroupsTest-1081966816 None] Created volume successfully. Jun 19 04:18:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Acquiring lock "cinder-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Lock "cinder-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Acquiring lock "cinder-quobyte-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Lock "cinder-quobyte-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0" acquired by "delete_volume" :: waited 0.032s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:03 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.903s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:03 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:03 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Deleted volume successfully. Jun 19 04:18:03 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec235488-e9bd-4fcb-a7f7-9ac192e5f6d4]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-feabe327-98fc-4a85-a26f-8d6f5a9e6789 tempest-VolumesTestJSON-244838430 None] Lock "cinder-b9047559-fb4a-4fc5-8cef-724a05c199c3-delete_volume" released by "delete_volume" :: held 3.805s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:03 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0 Jun 19 04:18:03 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:04 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0" returned: 0 in 0.935s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:04 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0 Jun 19 04:18:04 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:04 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Flow 'volume_create_manager' (2919888b-63c2-4902-97fa-06d8ffb53534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebf19db-5015-47ff-81e1-6a77e5184750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ebf19db-5015-47ff-81e1-6a77e5184750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-186391134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ee3e42f-8799-47e6-9137-30b5a8f42c6c,host='devstack@QuobyteHD#QuobyteHD',id=0ec02a55-238b-4037-984f-8d0a7edf1767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890b2256f2104de49cc1317ec3f68948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:05Z,use_quota=True,user_id='69a60787c21546bca376035d68278827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9add9487-abf5-40fb-8a45-2a9ebb8be4eb),volume_type_id=9add9487-abf5-40fb-8a45-2a9ebb8be4eb)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0baa1c01-2886-48f8-96f5-3b6e9f6fce53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0baa1c01-2886-48f8-96f5-3b6e9f6fce53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34684f8c-6e97-4261-815d-b714379edfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34684f8c-6e97-4261-815d-b714379edfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec02a55-238b-4037-984f-8d0a7edf1767', 'volume_name': 'volume-0ec02a55-238b-4037-984f-8d0a7edf1767', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd48e96-432a-4404-b17d-1206fdfd80bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd48e96-432a-4404-b17d-1206fdfd80bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee18bf52-3e23-4126-af26-5c7a9cdd17ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:05 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Volume 0ec02a55-238b-4037-984f-8d0a7edf1767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec02a55-238b-4037-984f-8d0a7edf1767', 'volume_size': 1} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9ee3e42f-8799-47e6-9137-30b5a8f42c6c,created_at=2026-06-19T02:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-186391134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ee3e42f-8799-47e6-9137-30b5a8f42c6c,host='devstack@QuobyteHD#QuobyteHD',id=0ec02a55-238b-4037-984f-8d0a7edf1767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='890b2256f2104de49cc1317ec3f68948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:05Z,use_quota=True,user_id='69a60787c21546bca376035d68278827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9add9487-abf5-40fb-8a45-2a9ebb8be4eb),volume_type_id=9add9487-abf5-40fb-8a45-2a9ebb8be4eb)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Creating volume 0ec02a55-238b-4037-984f-8d0a7edf1767 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:05 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0ec02a55-238b-4037-984f-8d0a7edf1767 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:05 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0ec02a55-238b-4037-984f-8d0a7edf1767 1073741824 Jun 19 04:18:05 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:05 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0" returned: 0 in 0.921s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Lock "cinder-quobyte-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0" released by "delete_volume" :: held 1.924s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Created reservations ['80d5aba3-d77d-4a51-a644-b6aff61c8292', '60912054-eeba-4de4-b73a-f14a3b70c178', '1026f027-295c-412b-8564-498699b69c10', 'aafecddc-b191-4dcd-bcd8-25e451a6942e'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:05 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:18:05 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Acquiring lock "cinder-0b4280e5-4f9a-45c2-b61e-8b8079827721-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Lock "cinder-0b4280e5-4f9a-45c2-b61e-8b8079827721-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Acquiring lock "cinder-quobyte-0b4280e5-4f9a-45c2-b61e-8b8079827721" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:05 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Lock "cinder-quobyte-0b4280e5-4f9a-45c2-b61e-8b8079827721" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:06 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1970dd5-14f8-47f8-be2a-d79325794f19]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0b4280e5-4f9a-45c2-b61e-8b8079827721 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:06 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0b4280e5-4f9a-45c2-b61e-8b8079827721 Jun 19 04:18:06 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:06 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.043s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:06 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:06 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Deleted volume successfully. Jun 19 04:18:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-70f78ab1-4cf8-4abd-adf1-87686c3e28b0 tempest-VolumesTestJSON-244838430 None] Lock "cinder-0bf5bf4d-7ad2-4cd4-8ae3-8c3da6ba26d0-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:06 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0ec02a55-238b-4037-984f-8d0a7edf1767 1073741824" returned: 0 in 1.446s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0ec02a55-238b-4037-984f-8d0a7edf1767 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:06 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0ec02a55-238b-4037-984f-8d0a7edf1767 Jun 19 04:18:06 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:07 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0b4280e5-4f9a-45c2-b61e-8b8079827721" returned: 0 in 1.084s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0b4280e5-4f9a-45c2-b61e-8b8079827721 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:07 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0b4280e5-4f9a-45c2-b61e-8b8079827721 Jun 19 04:18:07 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:07 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0ec02a55-238b-4037-984f-8d0a7edf1767" returned: 0 in 0.874s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] <== create_volume: return (2371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.375s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee18bf52-3e23-4126-af26-5c7a9cdd17ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec02a55-238b-4037-984f-8d0a7edf1767', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1adb20b-c154-4051-ab5b-759fbd181013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:07 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Volume volume-0ec02a55-238b-4037-984f-8d0a7edf1767 (0ec02a55-238b-4037-984f-8d0a7edf1767): created successfully Jun 19 04:18:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1adb20b-c154-4051-ab5b-759fbd181013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Flow 'volume_create_manager' (2919888b-63c2-4902-97fa-06d8ffb53534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:07 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-4549ff8a-690a-41fd-97f2-e5263809a81a tempest-GroupsTest-1081966816 None] Created volume successfully. Jun 19 04:18:07 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0b4280e5-4f9a-45c2-b61e-8b8079827721" returned: 0 in 0.784s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:07 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Lock "cinder-quobyte-0b4280e5-4f9a-45c2-b61e-8b8079827721" released by "delete_volume" :: held 1.918s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:07 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Created reservations ['977a7286-1144-443a-8dfc-586c0441ce61', '69e38785-8c37-4775-a5f4-8684ee7fcd0a', 'e7484324-1354-431b-a5a7-108f7e6700d4', 'fd8b8be7-5809-4711-ba26-65f0411a953b'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:08 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:18:08 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:08 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-36a8e113-51c0-4f55-92db-c3f02c8ecd99 tempest-GroupsTest-1081966816 None] Update group completed successfully. Jun 19 04:18:09 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.941s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:09 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:09 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Deleted volume successfully. Jun 19 04:18:09 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e5b23a1b-f305-477c-be1c-52b793024aed tempest-VolumesTestJSON-244838430 None] Lock "cinder-0b4280e5-4f9a-45c2-b61e-8b8079827721-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:10 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-1988d6bb-220c-456b-81c8-ea60d781cda8 tempest-GroupsTest-1081966816 None] Update group completed successfully. Jun 19 04:18:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Acquiring lock "cinder-quobyte-0ec02a55-238b-4037-984f-8d0a7edf1767" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Lock "cinder-quobyte-0ec02a55-238b-4037-984f-8d0a7edf1767" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:12 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9afa87-7b1c-4786-959e-c6995f4bf46b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0ec02a55-238b-4037-984f-8d0a7edf1767 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:12 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0ec02a55-238b-4037-984f-8d0a7edf1767 Jun 19 04:18:12 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:12 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Flow 'volume_create_manager' (3009615f-3934-4585-8a1d-68bd84f100fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91aa95ff-8f92-4bce-aa96-73dc961a9f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91aa95ff-8f92-4bce-aa96-73dc961a9f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2024055932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15413bd9-eb2b-4cf7-9bcc-e562b9d0a999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6768215517417ba285510f867ace2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:13Z,use_quota=True,user_id='b3a18ad4de2c4e068b551c09c8af2151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eec10f1-1368-41c2-b52b-dcd0eddfff1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eec10f1-1368-41c2-b52b-dcd0eddfff1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d075bf66-ae6b-4eb3-b547-042dd06c0a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d075bf66-ae6b-4eb3-b547-042dd06c0a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15413bd9-eb2b-4cf7-9bcc-e562b9d0a999', 'volume_name': 'volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b8d00b-6ee6-4d5e-9389-6dcf36e0e2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5b8d00b-6ee6-4d5e-9389-6dcf36e0e2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdfeeb1-32f9-4724-b66a-23f1407931d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:13 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Volume 15413bd9-eb2b-4cf7-9bcc-e562b9d0a999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999', 'volume_size': 1} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2024055932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15413bd9-eb2b-4cf7-9bcc-e562b9d0a999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6768215517417ba285510f867ace2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:13Z,use_quota=True,user_id='b3a18ad4de2c4e068b551c09c8af2151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Creating volume 15413bd9-eb2b-4cf7-9bcc-e562b9d0a999 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:13 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:13 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999 1073741824 Jun 19 04:18:13 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:13 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0ec02a55-238b-4037-984f-8d0a7edf1767" returned: 0 in 0.922s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0ec02a55-238b-4037-984f-8d0a7edf1767 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:13 devstack sudo[99863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0ec02a55-238b-4037-984f-8d0a7edf1767 Jun 19 04:18:13 devstack sudo[99863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:14 devstack sudo[99863]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0ec02a55-238b-4037-984f-8d0a7edf1767" returned: 0 in 0.848s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Lock "cinder-quobyte-0ec02a55-238b-4037-984f-8d0a7edf1767" released by "delete_volume" :: held 1.830s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Acquiring lock "cinder-quobyte-61eeee6e-8220-4dae-988e-859160da3c0a" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Lock "cinder-quobyte-61eeee6e-8220-4dae-988e-859160da3c0a" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:14 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b7412e-d2a5-422e-9a17-da8d2c6974e1]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-61eeee6e-8220-4dae-988e-859160da3c0a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:14 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999 1073741824" returned: 0 in 1.058s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:14 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999 Jun 19 04:18:14 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:14 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-61eeee6e-8220-4dae-988e-859160da3c0a Jun 19 04:18:14 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:15 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999" returned: 0 in 0.876s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cdfeeb1-32f9-4724-b66a-23f1407931d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6720a18b-98a6-4e00-bf75-eeb1dc0a95fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:15 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Volume volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999 (15413bd9-eb2b-4cf7-9bcc-e562b9d0a999): created successfully Jun 19 04:18:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6720a18b-98a6-4e00-bf75-eeb1dc0a95fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Flow 'volume_create_manager' (3009615f-3934-4585-8a1d-68bd84f100fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-0d47eb60-3ebd-4ae0-a8f0-31686004b169 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Created volume successfully. Jun 19 04:18:15 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-61eeee6e-8220-4dae-988e-859160da3c0a" returned: 0 in 1.161s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-61eeee6e-8220-4dae-988e-859160da3c0a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:15 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-61eeee6e-8220-4dae-988e-859160da3c0a Jun 19 04:18:15 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:15 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-61eeee6e-8220-4dae-988e-859160da3c0a" returned: 0 in 0.694s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Lock "cinder-quobyte-61eeee6e-8220-4dae-988e-859160da3c0a" released by "delete_volume" :: held 1.915s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:16 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Created reservations ['bdfd3958-9bcd-4568-9455-c566ea97fa77'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:16 devstack cinder-volume[93530]: WARNING cinder.quota [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-548687084 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-548687084, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:18:16 devstack cinder-volume[93530]: WARNING cinder.quota [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-548687084 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-548687084, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:18:16 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Created reservations ['d8eb60f6-3b88-4120-9f1d-9a3dca867f7b', '36736f7e-3fe5-474a-ae74-d1855f2b1830', '274c3038-8a1f-4267-9165-78026c506223', 'c55802ca-2d4a-40e1-80d7-c847e8f905cc'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:16 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Created reservations ['636a3e62-20ed-4d5c-a5c4-0f79d401de93', '58333a8f-316f-43a6-8c37-da6ec10db495', '45a971d9-43aa-46a9-beb0-2862bf5ead0b', '60a1f3bf-f4f9-4856-a92a-f3f094dc1142'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:16 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:18:16 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:17 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.694s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:17 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:17 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e13f2557-ded7-4c23-981d-4cb8dac9b849 tempest-GroupsTest-1081966816 None] Delete group completed successfully. Jun 19 04:18:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Acquiring lock "cinder-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Lock "cinder-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Acquiring lock "cinder-quobyte-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Lock "cinder-quobyte-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999" acquired by "delete_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:17 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bb3ab3-bfd9-4926-b9f1-b32812cfcd34]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:17 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999 Jun 19 04:18:17 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:18 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999" returned: 0 in 0.843s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:18 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999 Jun 19 04:18:18 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:19 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999" returned: 0 in 0.871s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Lock "cinder-quobyte-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999" released by "delete_volume" :: held 1.762s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:19 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Created reservations ['69f579e2-10db-4d98-b54c-a4a01448f078', 'fe85c162-8707-41be-bb2d-f1227e7feb63', 'e964864d-7fe4-416d-8a1a-91ac8ec5bc33', '5973357b-473a-4a73-a886-e2bcf0b6b88b'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:19 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:18:19 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Flow 'volume_create_manager' (5b38916c-851d-4d3c-ba4c-0851680176b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9057c1e8-5e7f-4885-ac40-5e20ba2696ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9057c1e8-5e7f-4885-ac40-5e20ba2696ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1959967296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54466a52-6ac2-4401-9bc9-c5b03f88bec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6be0a212ae415bbdc43ff339c3db51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:20Z,use_quota=True,user_id='765e938a80a04d7cac57a6a7f15a7040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef9efd5-c5f0-4176-90db-d35cd1c8cb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ef9efd5-c5f0-4176-90db-d35cd1c8cb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1897cab1-5a58-499b-a4b6-e1c11ff87fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1897cab1-5a58-499b-a4b6-e1c11ff87fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54466a52-6ac2-4401-9bc9-c5b03f88bec1', 'volume_name': 'volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0c26ae-c82a-4c05-9f20-38584c212a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac0c26ae-c82a-4c05-9f20-38584c212a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce16024-1466-4677-8211-dd50e7ef769b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:20 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Volume 54466a52-6ac2-4401-9bc9-c5b03f88bec1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1', 'volume_size': 1} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1959967296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54466a52-6ac2-4401-9bc9-c5b03f88bec1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6be0a212ae415bbdc43ff339c3db51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:20Z,use_quota=True,user_id='765e938a80a04d7cac57a6a7f15a7040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Creating volume 54466a52-6ac2-4401-9bc9-c5b03f88bec1 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:20 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:20 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1 1073741824 Jun 19 04:18:20 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:20 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.048s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:20 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Deleted volume successfully. Jun 19 04:18:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-18f126c2-1ccc-49da-b843-dcbceba71808 tempest-VolumeQuotasNegativeTestJSON-1838079264 None] Lock "cinder-15413bd9-eb2b-4cf7-9bcc-e562b9d0a999-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:21 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1 1073741824" returned: 0 in 1.261s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:21 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:INSERT=24,cinder:UPDATE=131,cinder:SELECT=105,cinder:DELETE=4 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:18:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:21 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1 Jun 19 04:18:21 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:22 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1" returned: 0 in 0.851s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:22 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=88,cinder:INSERT=34,cinder:UPDATE=123,cinder:DELETE=10 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:18:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce16024-1466-4677-8211-dd50e7ef769b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d02f6e-f760-46ac-8e03-5f9fc3024ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:22 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Volume volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1 (54466a52-6ac2-4401-9bc9-c5b03f88bec1): created successfully Jun 19 04:18:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d02f6e-f760-46ac-8e03-5f9fc3024ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Flow 'volume_create_manager' (5b38916c-851d-4d3c-ba4c-0851680176b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:22 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ac8abaaa-1509-49db-9fff-e67618db9e56 tempest-AttachVolumeTestJSON-665193495 None] Created volume successfully. Jun 19 04:18:25 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-4487720f-ac11-49a8-b9ac-ff51cd71ce00 tempest-GroupsV320Test-849860743 None] Group tempest-GroupsV320Test-Group-957457652: creating Jun 19 04:18:25 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-4487720f-ac11-49a8-b9ac-ff51cd71ce00 tempest-GroupsV320Test-849860743 None] Group tempest-GroupsV320Test-Group-957457652: created successfully Jun 19 04:18:25 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-4487720f-ac11-49a8-b9ac-ff51cd71ce00 tempest-GroupsV320Test-849860743 None] Create group completed successfully. Jun 19 04:18:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-387a4f4d-5105-493f-b348-550d80b26f9b req-04f46457-f218-4ae5-bf50-833bc2f38f7c tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-387a4f4d-5105-493f-b348-550d80b26f9b req-04f46457-f218-4ae5-bf50-833bc2f38f7c tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:26 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db75f95-5434-4486-8671-5ed19b2cd09e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-387a4f4d-5105-493f-b348-550d80b26f9b req-04f46457-f218-4ae5-bf50-833bc2f38f7c tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:26 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1 Jun 19 04:18:26 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Flow 'volume_create_manager' (037be147-6508-4ae4-a84d-ae82f5820524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed666ce-4167-42f3-91d0-f070acd05e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ed666ce-4167-42f3-91d0-f070acd05e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1649066359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e05118-554a-404e-b11e-8b7619749b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3da096d58549b092af54e877db28eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:27Z,use_quota=True,user_id='cbdff5b0f2b24985a7e0cc22ba2140da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef9ef95-29a2-4e2a-813d-db86886ab2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef9ef95-29a2-4e2a-813d-db86886ab2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a9f8c9-a83b-402a-9d94-d95808b11137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a9f8c9-a83b-402a-9d94-d95808b11137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e05118-554a-404e-b11e-8b7619749b22', 'volume_name': 'volume-c0e05118-554a-404e-b11e-8b7619749b22', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3b034a-3839-46a5-9003-5d635e081d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3b034a-3839-46a5-9003-5d635e081d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121ffaf9-8fbc-4770-8c2c-80d226511813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Volume c0e05118-554a-404e-b11e-8b7619749b22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e05118-554a-404e-b11e-8b7619749b22', 'volume_size': 1} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:27 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-387a4f4d-5105-493f-b348-550d80b26f9b req-04f46457-f218-4ae5-bf50-833bc2f38f7c tempest-AttachVolumeTestJSON-665193495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1" returned: 0 in 0.782s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-387a4f4d-5105-493f-b348-550d80b26f9b req-04f46457-f218-4ae5-bf50-833bc2f38f7c tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.799s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.196s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1649066359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e05118-554a-404e-b11e-8b7619749b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b3da096d58549b092af54e877db28eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:27Z,use_quota=True,user_id='cbdff5b0f2b24985a7e0cc22ba2140da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Creating volume c0e05118-554a-404e-b11e-8b7619749b22 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:27 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0e05118-554a-404e-b11e-8b7619749b22 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:27 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0e05118-554a-404e-b11e-8b7619749b22 1073741824 Jun 19 04:18:27 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-387a4f4d-5105-493f-b348-550d80b26f9b req-04f46457-f218-4ae5-bf50-833bc2f38f7c tempest-AttachVolumeTestJSON-665193495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd95f9810-c14c-49b8-8037-05faa1bfae63', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:18:27 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-387a4f4d-5105-493f-b348-550d80b26f9b req-04f46457-f218-4ae5-bf50-833bc2f38f7c tempest-AttachVolumeTestJSON-665193495 None] attachment_update completed successfully. Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Flow 'volume_create_manager' (90850ad0-dd08-4ac8-be49-e2d2eb5c3b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165232b0-6449-4c02-8b43-7e1665415813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (165232b0-6449-4c02-8b43-7e1665415813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1003719565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1761cb3f-c74d-4b97-b16b-4469defb4c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a193fe1254a74bad97163ff706950f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:28Z,use_quota=True,user_id='3deb98f41e4d4751b71360ce3923cb32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb50f36c-8318-4b27-b56d-b3006d102c82),volume_type_id=bb50f36c-8318-4b27-b56d-b3006d102c82)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5781664c-f4e5-481b-8575-0ef56bd75641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5781664c-f4e5-481b-8575-0ef56bd75641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e63e60a-d8c2-4e9b-a256-bfa5dd53aa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e63e60a-d8c2-4e9b-a256-bfa5dd53aa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1761cb3f-c74d-4b97-b16b-4469defb4c55', 'volume_name': 'volume-1761cb3f-c74d-4b97-b16b-4469defb4c55', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35123f7f-d8e7-469d-b2a3-f6685a92a41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35123f7f-d8e7-469d-b2a3-f6685a92a41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fc16b2-005b-4d9f-8002-a9fd4ac583b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:27 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Volume 1761cb3f-c74d-4b97-b16b-4469defb4c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1761cb3f-c74d-4b97-b16b-4469defb4c55', 'volume_size': 1} Jun 19 04:18:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:28 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-a7042396-6942-4cb2-990c-8d312d8680b4 tempest-GroupsV320Test-849860743 None] Created reservations ['fbc591d9-428f-4d11-9d29-4ea4700372f6'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a7042396-6942-4cb2-990c-8d312d8680b4 tempest-GroupsV320Test-849860743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a7042396-6942-4cb2-990c-8d312d8680b4 tempest-GroupsV320Test-849860743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a7042396-6942-4cb2-990c-8d312d8680b4 tempest-GroupsV320Test-849860743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a7042396-6942-4cb2-990c-8d312d8680b4 tempest-GroupsV320Test-849860743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a7042396-6942-4cb2-990c-8d312d8680b4 tempest-GroupsV320Test-849860743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a7042396-6942-4cb2-990c-8d312d8680b4 tempest-GroupsV320Test-849860743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:28 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:18:28 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:28 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0e05118-554a-404e-b11e-8b7619749b22 1073741824" returned: 0 in 0.974s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0e05118-554a-404e-b11e-8b7619749b22 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:28 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0e05118-554a-404e-b11e-8b7619749b22 Jun 19 04:18:28 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:28 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a7042396-6942-4cb2-990c-8d312d8680b4 tempest-GroupsV320Test-849860743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.677s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:28 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-a7042396-6942-4cb2-990c-8d312d8680b4 tempest-GroupsV320Test-849860743 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:28 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a7042396-6942-4cb2-990c-8d312d8680b4 tempest-GroupsV320Test-849860743 None] Delete group completed successfully. Jun 19 04:18:29 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0e05118-554a-404e-b11e-8b7619749b22" returned: 0 in 0.708s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.415s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1003719565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1761cb3f-c74d-4b97-b16b-4469defb4c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a193fe1254a74bad97163ff706950f34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:28Z,use_quota=True,user_id='3deb98f41e4d4751b71360ce3923cb32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb50f36c-8318-4b27-b56d-b3006d102c82),volume_type_id=bb50f36c-8318-4b27-b56d-b3006d102c82)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Creating volume 1761cb3f-c74d-4b97-b16b-4469defb4c55 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:29 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1761cb3f-c74d-4b97-b16b-4469defb4c55 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (121ffaf9-8fbc-4770-8c2c-80d226511813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e05118-554a-404e-b11e-8b7619749b22', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:29 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1761cb3f-c74d-4b97-b16b-4469defb4c55 1073741824 Jun 19 04:18:29 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5e21cc-208b-4c58-bdec-34c6efed7abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:29 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Volume volume-c0e05118-554a-404e-b11e-8b7619749b22 (c0e05118-554a-404e-b11e-8b7619749b22): created successfully Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5e21cc-208b-4c58-bdec-34c6efed7abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Flow 'volume_create_manager' (037be147-6508-4ae4-a84d-ae82f5820524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:29 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-1de8afd1-6d1b-48be-ad6d-bb152948b094 tempest-VolumesServicesTestJSON-1891533544 None] Created volume successfully. Jun 19 04:18:30 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1761cb3f-c74d-4b97-b16b-4469defb4c55 1073741824" returned: 0 in 0.975s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1761cb3f-c74d-4b97-b16b-4469defb4c55 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:30 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1761cb3f-c74d-4b97-b16b-4469defb4c55 Jun 19 04:18:30 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:30 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Acquiring lock "cinder-c0e05118-554a-404e-b11e-8b7619749b22-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:30 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Lock "cinder-c0e05118-554a-404e-b11e-8b7619749b22-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:30 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Acquiring lock "cinder-quobyte-c0e05118-554a-404e-b11e-8b7619749b22" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:30 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Lock "cinder-quobyte-c0e05118-554a-404e-b11e-8b7619749b22" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:30 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[96468b1c-842e-4f85-a2e3-6fed26af4ced]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0e05118-554a-404e-b11e-8b7619749b22 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:31 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0e05118-554a-404e-b11e-8b7619749b22 Jun 19 04:18:31 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:31 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1761cb3f-c74d-4b97-b16b-4469defb4c55" returned: 0 in 0.826s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fc16b2-005b-4d9f-8002-a9fd4ac583b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1761cb3f-c74d-4b97-b16b-4469defb4c55', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b02e6b8-31b4-49d1-80ab-1ed00321ae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:31 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Volume volume-1761cb3f-c74d-4b97-b16b-4469defb4c55 (1761cb3f-c74d-4b97-b16b-4469defb4c55): created successfully Jun 19 04:18:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b02e6b8-31b4-49d1-80ab-1ed00321ae91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Flow 'volume_create_manager' (90850ad0-dd08-4ac8-be49-e2d2eb5c3b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:31 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-bbc6d2e9-3787-4681-89b2-a3c8a81524ec tempest-VolumeTypesAccessTest-1546330885 None] Created volume successfully. Jun 19 04:18:31 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0e05118-554a-404e-b11e-8b7619749b22" returned: 0 in 0.931s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0e05118-554a-404e-b11e-8b7619749b22 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:31 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0e05118-554a-404e-b11e-8b7619749b22 Jun 19 04:18:31 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Acquiring lock "cinder-1761cb3f-c74d-4b97-b16b-4469defb4c55-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Lock "cinder-1761cb3f-c74d-4b97-b16b-4469defb4c55-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Acquiring lock "cinder-quobyte-1761cb3f-c74d-4b97-b16b-4469defb4c55" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Lock "cinder-quobyte-1761cb3f-c74d-4b97-b16b-4469defb4c55" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d78114-d990-46a9-9c04-799f66a177ff]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1761cb3f-c74d-4b97-b16b-4469defb4c55 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:32 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0e05118-554a-404e-b11e-8b7619749b22" returned: 0 in 0.821s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:32 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1761cb3f-c74d-4b97-b16b-4469defb4c55 Jun 19 04:18:32 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Lock "cinder-quobyte-c0e05118-554a-404e-b11e-8b7619749b22" released by "delete_volume" :: held 1.814s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Created reservations ['930e7aa7-baae-405f-af13-2d214ee52650', 'cf733271-36bf-4d8c-8551-87d4e77565b8', 'd9e3e6f0-b58f-4116-8193-1f0fdcea8bb2', 'bd7fbc9a-6d8f-4c02-a2d8-623eb1c061ac'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:32 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:18:32 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:33 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1761cb3f-c74d-4b97-b16b-4469defb4c55" returned: 0 in 0.890s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1761cb3f-c74d-4b97-b16b-4469defb4c55 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:33 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1761cb3f-c74d-4b97-b16b-4469defb4c55 Jun 19 04:18:33 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:33 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.788s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:33 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:33 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Deleted volume successfully. Jun 19 04:18:33 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d4fbdb86-da9c-4edd-a14d-88a531cb812e tempest-VolumesServicesTestJSON-1891533544 None] Lock "cinder-c0e05118-554a-404e-b11e-8b7619749b22-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:34 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1761cb3f-c74d-4b97-b16b-4469defb4c55" returned: 0 in 1.044s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:34 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Lock "cinder-quobyte-1761cb3f-c74d-4b97-b16b-4469defb4c55" released by "delete_volume" :: held 1.998s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:34 devstack cinder-volume[93530]: WARNING cinder.quota [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1644645531 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1644645531, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:18:34 devstack cinder-volume[93530]: WARNING cinder.quota [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1644645531 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1644645531, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:18:34 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Created reservations ['29aab496-50df-4a73-9c00-3b762f73c627', 'c27a8f53-fb61-4185-8985-ae584167d707', '82d03d90-da23-411c-86b2-ac48caa3d8a8', '02c1fb39-1daa-4b15-a8b8-3291429027c1'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:34 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:18:34 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:35 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.310s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:35 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:35 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Deleted volume successfully. Jun 19 04:18:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ba4efe2c-a6c0-4ee2-ae8e-cacc9aad17f3 tempest-VolumeTypesAccessTest-1546330885 None] Lock "cinder-1761cb3f-c74d-4b97-b16b-4469defb4c55-delete_volume" released by "delete_volume" :: held 3.691s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:38 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Flow 'volume_create_manager' (12140d7b-177d-4e5a-a47f-54e39cba2a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6f0aba-4a81-4c1d-a6d7-c27184a81f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6f0aba-4a81-4c1d-a6d7-c27184a81f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-258551890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e907b4-e10d-4f7c-b7b9-85e6ad88357f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a9156e169f4191895655478a92fad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:39Z,use_quota=True,user_id='2bf27d2e59604d538b72fb386a2d6b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea0ed02-f35f-4645-973b-03c3e3a8af2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ea0ed02-f35f-4645-973b-03c3e3a8af2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e13098-abe4-4a4d-b907-51327764fbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e13098-abe4-4a4d-b907-51327764fbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50e907b4-e10d-4f7c-b7b9-85e6ad88357f', 'volume_name': 'volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62277b50-8535-4e64-b918-e162bb0b7e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62277b50-8535-4e64-b918-e162bb0b7e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fa4c6d-0da3-4455-a7cc-c5dda52dfa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:39 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Volume 50e907b4-e10d-4f7c-b7b9-85e6ad88357f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f', 'volume_size': 1} Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-258551890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e907b4-e10d-4f7c-b7b9-85e6ad88357f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a9156e169f4191895655478a92fad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:39Z,use_quota=True,user_id='2bf27d2e59604d538b72fb386a2d6b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Creating volume 50e907b4-e10d-4f7c-b7b9-85e6ad88357f {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:39 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:18:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:39 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f 1073741824 Jun 19 04:18:39 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:40 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f 1073741824" returned: 0 in 0.997s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:40 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f Jun 19 04:18:40 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:40 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f" returned: 0 in 0.790s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fa4c6d-0da3-4455-a7cc-c5dda52dfa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320c6f02-5f19-40a4-aeaf-4a580daad1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:40 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Volume volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f (50e907b4-e10d-4f7c-b7b9-85e6ad88357f): created successfully Jun 19 04:18:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320c6f02-5f19-40a4-aeaf-4a580daad1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Flow 'volume_create_manager' (12140d7b-177d-4e5a-a47f-54e39cba2a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:41 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-2542d3c5-26ad-4f73-8b00-5df2a85c135c tempest-VolumeQuotasAdminTestJSON-907339765 None] Created volume successfully. Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Flow 'volume_create_manager' (56a0cc89-f20b-41ea-a5f0-6ce3e1b734d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ce5e55-be61-46d1-8cb1-54b68c3a2309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ce5e55-be61-46d1-8cb1-54b68c3a2309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-88703136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd0d3a62b8a49abbb14c0e212f8c244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:41Z,use_quota=True,user_id='e3b10f5fde094b1c94d57054fe1d3dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2fca54-67d1-416a-9b4e-7b659da8ebb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2fca54-67d1-416a-9b4e-7b659da8ebb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e218e3-fa51-482b-a35b-6cf32dcde9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e218e3-fa51-482b-a35b-6cf32dcde9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1', 'volume_name': 'volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b468cce-1ba9-4596-a6d9-87970c48f9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b468cce-1ba9-4596-a6d9-87970c48f9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31754e00-07c1-4bee-83cd-8be8a2a0489e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:41 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Volume 1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1', 'volume_size': 1} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-88703136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd0d3a62b8a49abbb14c0e212f8c244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:41Z,use_quota=True,user_id='e3b10f5fde094b1c94d57054fe1d3dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Creating volume 1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:41 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:18:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:41 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 1073741824 Jun 19 04:18:41 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Acquiring lock "cinder-50e907b4-e10d-4f7c-b7b9-85e6ad88357f-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Lock "cinder-50e907b4-e10d-4f7c-b7b9-85e6ad88357f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Acquiring lock "cinder-quobyte-50e907b4-e10d-4f7c-b7b9-85e6ad88357f" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Lock "cinder-quobyte-50e907b4-e10d-4f7c-b7b9-85e6ad88357f" acquired by "delete_volume" :: waited 0.015s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:42 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[91998992-d8c5-4c8b-8236-1d2f61e9257e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:42 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 1073741824" returned: 0 in 1.003s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:42 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 Jun 19 04:18:42 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:42 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f Jun 19 04:18:42 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:43 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1" returned: 0 in 0.725s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31754e00-07c1-4bee-83cd-8be8a2a0489e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b2a0c4-e35a-4fec-b516-481e849c2600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:43 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Volume volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 (1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1): created successfully Jun 19 04:18:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b2a0c4-e35a-4fec-b516-481e849c2600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Flow 'volume_create_manager' (56a0cc89-f20b-41ea-a5f0-6ce3e1b734d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:43 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-49386985-db5f-43ba-9335-5244065910a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Created volume successfully. Jun 19 04:18:43 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f" returned: 0 in 0.932s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:43 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f Jun 19 04:18:43 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Creating offline snapshot fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec of volume 1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:18:43 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f8162a-2ede-48dd-8079-4a7683aa3bf2]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:44 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 Jun 19 04:18:44 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:44 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-50e907b4-e10d-4f7c-b7b9-85e6ad88357f" returned: 0 in 0.795s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Lock "cinder-quobyte-50e907b4-e10d-4f7c-b7b9-85e6ad88357f" released by "delete_volume" :: held 1.782s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:44 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Created reservations ['b2fbd664-02f3-44eb-a6b2-ed7b84ba60bc', 'f43394f1-db73-4462-9b8c-4d2ac78eead1', '9299dbcd-d5da-412d-8c54-13783cfa125f', 'b1ae1ff4-9636-4d8e-96db-fb36352480f8'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:44 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:18:44 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:44 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1" returned: 0 in 1.010s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:44 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec 1G Jun 19 04:18:44 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:45 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.923s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:45 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Deleted volume successfully. Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-09b08ad7-9af5-421f-a17a-2622cf4cf46e tempest-VolumeQuotasAdminTestJSON-907339765 None] Lock "cinder-50e907b4-e10d-4f7c-b7b9-85e6ad88357f-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Flow 'volume_create_manager' (f6410527-9326-44ee-a204-06b257142357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd650e6b-f188-414b-b6ed-7b6439fcab65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd650e6b-f188-414b-b6ed-7b6439fcab65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-580449672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eac5200-cde5-4553-bb04-1494b8447ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a9156e169f4191895655478a92fad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:45Z,use_quota=True,user_id='2bf27d2e59604d538b72fb386a2d6b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471bd7d5-09ff-48ab-82f5-448f0f71b603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471bd7d5-09ff-48ab-82f5-448f0f71b603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efd4dbb-bb34-4eef-a0e6-48b47d324b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efd4dbb-bb34-4eef-a0e6-48b47d324b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eac5200-cde5-4553-bb04-1494b8447ec6', 'volume_name': 'volume-7eac5200-cde5-4553-bb04-1494b8447ec6', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2258befd-9ead-4339-84bf-2335877a43ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2258befd-9ead-4339-84bf-2335877a43ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347b6483-3172-4a31-8025-8948c6515726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:45 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Volume 7eac5200-cde5-4553-bb04-1494b8447ec6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eac5200-cde5-4553-bb04-1494b8447ec6', 'volume_size': 1} Jun 19 04:18:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:46 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec 1G" returned: 0 in 1.157s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:46 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec Jun 19 04:18:46 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:47 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec" returned: 0 in 1.007s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:47 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec is being set with open permissions: ugo+rw Jun 19 04:18:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:47 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec Jun 19 04:18:47 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:48 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec" returned: 0 in 1.097s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:48 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.info Jun 19 04:18:48 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:49 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.info" returned: 0 in 0.802s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:49 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.info is being set with open permissions: ugo+rw Jun 19 04:18:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:49 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.info Jun 19 04:18:49 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:49 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.info" returned: 0 in 0.713s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.952s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.247s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-580449672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eac5200-cde5-4553-bb04-1494b8447ec6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a9156e169f4191895655478a92fad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:45Z,use_quota=True,user_id='2bf27d2e59604d538b72fb386a2d6b3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Creating volume 7eac5200-cde5-4553-bb04-1494b8447ec6 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:49 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:18:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7eac5200-cde5-4553-bb04-1494b8447ec6 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:49 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7eac5200-cde5-4553-bb04-1494b8447ec6 1073741824 Jun 19 04:18:49 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:49 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-834e75a2-c377-473f-aaaa-ad06dce6ddb6 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Create snapshot completed successfully Jun 19 04:18:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Acquiring lock "cinder-fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "cinder-fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Acquiring lock "cinder-quobyte-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "cinder-quobyte-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Acquiring lock "cinder-quobyte-fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "cinder-quobyte-fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Deleting offline snapshot fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec of volume 1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:18:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] snapshot_file for this snap is: volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:18:50 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a49d1cc-82e0-4a57-aced-14568692805f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:51 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec Jun 19 04:18:51 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:51 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7eac5200-cde5-4553-bb04-1494b8447ec6 1073741824" returned: 0 in 1.443s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7eac5200-cde5-4553-bb04-1494b8447ec6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:51 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7eac5200-cde5-4553-bb04-1494b8447ec6 Jun 19 04:18:51 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:52 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec" returned: 0 in 1.131s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:18:52 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7eac5200-cde5-4553-bb04-1494b8447ec6" returned: 0 in 0.836s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] <== create_volume: return (2336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.339s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:52 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a310d5-6b03-4e52-9b32-7e2e6d5871f1]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347b6483-3172-4a31-8025-8948c6515726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eac5200-cde5-4553-bb04-1494b8447ec6', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4de0a0-0ef4-4db7-aef2-432ceecadb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:52 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Volume volume-7eac5200-cde5-4553-bb04-1494b8447ec6 (7eac5200-cde5-4553-bb04-1494b8447ec6): created successfully Jun 19 04:18:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4de0a0-0ef4-4db7-aef2-432ceecadb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Flow 'volume_create_manager' (f6410527-9326-44ee-a204-06b257142357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:52 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-42b5ee51-6ad3-464d-9aba-b28ea64d2dbe tempest-VolumeQuotasAdminTestJSON-907339765 None] Created volume successfully. Jun 19 04:18:52 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 Jun 19 04:18:52 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:53 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1" returned: 0 in 0.948s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:53 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec Jun 19 04:18:53 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:54 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec" returned: 0 in 1.102s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:54 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-6d65ec5a-7187-4c2a-8e2e-1a76748323c5 tempest-VolumeQuotasAdminTestJSON-1604683929 None] Transfer volume completed successfully. Jun 19 04:18:54 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec Jun 19 04:18:54 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:55 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1.fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec" returned: 0 in 0.938s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "cinder-quobyte-fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec" released by "_delete_snapshot" :: held 4.255s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "cinder-quobyte-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1" released by "delete_snapshot" :: held 4.284s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:55 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Created reservations ['b57cacf7-98bd-4672-bfd3-f738ad9ab5f8', '7cee2ccc-7828-491c-a15a-63124aaf46fd', '70774879-a4cb-4c80-8803-8524e7abfc70', '1415847c-e238-4fca-aa65-8fd41a4574d7'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:55 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Delete snapshot completed successfully. Jun 19 04:18:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-5ae92bc6-7399-447b-b172-9faf48c0fa73 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "cinder-fbdd1b9d-cbe1-4b0f-bb6a-5a6f9c2deaec-delete_snapshot" released by "delete_snapshot" :: held 4.488s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Acquiring lock "cinder-7eac5200-cde5-4553-bb04-1494b8447ec6-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Lock "cinder-7eac5200-cde5-4553-bb04-1494b8447ec6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Acquiring lock "cinder-quobyte-7eac5200-cde5-4553-bb04-1494b8447ec6" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Lock "cinder-quobyte-7eac5200-cde5-4553-bb04-1494b8447ec6" acquired by "delete_volume" :: waited 0.045s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:55 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b29e0a-66da-4078-b1d1-b7623cc3d853]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7eac5200-cde5-4553-bb04-1494b8447ec6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:55 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7eac5200-cde5-4553-bb04-1494b8447ec6 Jun 19 04:18:55 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Acquiring lock "cinder-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "cinder-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Acquiring lock "cinder-quobyte-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "cinder-quobyte-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:56 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7eac5200-cde5-4553-bb04-1494b8447ec6" returned: 0 in 0.913s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7eac5200-cde5-4553-bb04-1494b8447ec6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:56 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[137d8845-f436-4681-9a72-bf902f2ee8c3]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:56 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7eac5200-cde5-4553-bb04-1494b8447ec6 Jun 19 04:18:56 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:56 devstack sudo[101051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 Jun 19 04:18:56 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:57 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7eac5200-cde5-4553-bb04-1494b8447ec6" returned: 0 in 0.835s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:57 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Lock "cinder-quobyte-7eac5200-cde5-4553-bb04-1494b8447ec6" released by "delete_volume" :: held 1.802s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:57 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Created reservations ['e9cbf6ab-6e70-42eb-bf7a-78829f73d2b9', 'c1c46d98-a7a5-49b2-8a0b-f748a037ef7c', 'ac1c57a7-33ba-4b6e-ae60-00f03ec8b978', '8b4e1fe8-337b-47fc-ae24-7113551eb09c'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:57 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1" returned: 0 in 0.985s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:57 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1 Jun 19 04:18:57 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:57 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:18:57 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:58 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.072s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:58 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:58 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Deleted volume successfully. Jun 19 04:18:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2a5ffdeb-4ddd-4bcf-b0c3-e405b32b87d0 tempest-VolumeQuotasAdminTestJSON-1275567714 None] Lock "cinder-7eac5200-cde5-4553-bb04-1494b8447ec6-delete_volume" released by "delete_volume" :: held 3.304s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:58 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1" returned: 0 in 1.282s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "cinder-quobyte-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1" released by "delete_volume" :: held 2.366s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:18:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:58 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:18:58 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:59 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Created reservations ['5c36a874-a5a8-4b17-af84-de5b9913f5ca', 'db4d388f-5adb-49a0-b848-21530e8fa437', '6c6059d8-a773-4dd5-9bb7-5bd54caa44df', '2c1766fc-6709-459f-b89e-4bb40d4d69f1'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:59 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:59 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:59 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:18:59 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:00 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.454s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:00 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:00 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:19:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 8 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:19:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:19:00 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.449s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:00 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:00 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Deleted volume successfully. Jun 19 04:19:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-cab12798-81a9-4080-8617-cb92c348f394 tempest-VolumeSnapshotQuotasNegativeTestJSON-978402889 None] Lock "cinder-1fe76b37-1fb4-4f21-b6ec-ebd13635d7f1-delete_volume" released by "delete_volume" :: held 4.230s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Flow 'volume_create_manager' (806b7910-f182-4369-9f19-f6a239633734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24038b47-1c99-49f7-a971-3f282b60042c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24038b47-1c99-49f7-a971-3f282b60042c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-83685085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b689770736244cc7a82a8071b5760e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:02Z,use_quota=True,user_id='cfa78131a6c34a33bdcaaa25cf7610ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77fd96ad-d15b-4f47-be0c-6b48648682f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77fd96ad-d15b-4f47-be0c-6b48648682f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1453ca32-e583-44bd-9f2c-2c7ef42a2ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1453ca32-e583-44bd-9f2c-2c7ef42a2ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23', 'volume_name': 'volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1247c27-deb4-4bc1-958a-39b3d8e2bd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1247c27-deb4-4bc1-958a-39b3d8e2bd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ddd0422-fd58-4038-bd3b-2699a7de4e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:02 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Volume 9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23', 'volume_size': 1} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-83685085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b689770736244cc7a82a8071b5760e04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:02Z,use_quota=True,user_id='cfa78131a6c34a33bdcaaa25cf7610ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Creating volume 9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:02 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:19:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:02 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 1073741824 Jun 19 04:19:02 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:03 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 1073741824" returned: 0 in 0.997s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:03 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 Jun 19 04:19:03 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:04 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23" returned: 0 in 0.878s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:04 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ddd0422-fd58-4038-bd3b-2699a7de4e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689b1a9d-3e04-4cc1-85db-e8dc26db0b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:04 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Volume volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 (9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23): created successfully Jun 19 04:19:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689b1a9d-3e04-4cc1-85db-e8dc26db0b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Flow 'volume_create_manager' (806b7910-f182-4369-9f19-f6a239633734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:04 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-5df2ae65-f68a-4891-a4e6-c462b0e27617 tempest-SnapshotMetadataTestJSON-724910099 None] Created volume successfully. Jun 19 04:19:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] Creating offline snapshot 2689f07f-268f-4d62-b88c-d4d11332e431 of volume 9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:19:05 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[726f462f-517a-47dd-ada6-3a0ee3c2ee94]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:06 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 Jun 19 04:19:06 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:06 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23" returned: 0 in 0.851s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:06 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 1G Jun 19 04:19:06 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:07 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 1G" returned: 0 in 0.998s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:07 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 Jun 19 04:19:07 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:07 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Flow 'volume_create_manager' (6d5b1541-51d1-4d2d-8a38-09454f487db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d7ecb7-d836-4756-9a9f-17e6e3b39a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d7ecb7-d836-4756-9a9f-17e6e3b39a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-289807607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c5c7ea-1239-4467-bb64-14a271987bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43635d38731c4dda92c98ef0a431517b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:08Z,use_quota=True,user_id='9f742de85cb54cfb82564a6e699557d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23000d81-2fe0-48e6-ad50-5b515ae3cd03),volume_type_id=23000d81-2fe0-48e6-ad50-5b515ae3cd03)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddc5d61-38f7-47af-aba6-07f21f5bb4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddc5d61-38f7-47af-aba6-07f21f5bb4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1012c1c6-01b1-405e-9357-f745e21a21b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1012c1c6-01b1-405e-9357-f745e21a21b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c5c7ea-1239-4467-bb64-14a271987bee', 'volume_name': 'volume-35c5c7ea-1239-4467-bb64-14a271987bee', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f0a9f0-5483-43f0-9b0c-67f3d638db9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f0a9f0-5483-43f0-9b0c-67f3d638db9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c237bed4-6f67-4f3a-906d-e017ebb4c224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:07 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Volume 35c5c7ea-1239-4467-bb64-14a271987bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c5c7ea-1239-4467-bb64-14a271987bee', 'volume_size': 1} Jun 19 04:19:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:08 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431" returned: 0 in 0.778s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:08 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 is being set with open permissions: ugo+rw Jun 19 04:19:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:08 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 Jun 19 04:19:08 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:09 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431" returned: 0 in 0.746s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:09 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.info Jun 19 04:19:09 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:09 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Flow 'volume_create_manager' (11c1c4d9-282c-4520-a017-3c82bb69bba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f9b0cb-f598-4525-b857-9c023aed3392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f9b0cb-f598-4525-b857-9c023aed3392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1024654421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4358289-47fe-40df-b287-bf616e657307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf7bd03c7454f07b72166bce92bb9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:10Z,use_quota=True,user_id='0021778d61c64ffab2bedfa9ab983c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a00f760-4c31-48d3-aff8-c8d93d157db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a00f760-4c31-48d3-aff8-c8d93d157db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a62df6-002d-478b-a65f-dd647fa921b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:09 devstack cinder-volume[93530]: DEBUG cinder.image.glance [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Creating Keystone auth plugin from conf {{(pid=93530) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:19:10 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.info" returned: 0 in 0.771s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:10 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.info is being set with open permissions: ugo+rw Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:10 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.info Jun 19 04:19:10 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a62df6-002d-478b-a65f-dd647fa921b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4358289-47fe-40df-b287-bf616e657307', 'volume_name': 'volume-c4358289-47fe-40df-b287-bf616e657307', 'volume_size': 1, 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41c991745fb845ed91d69be55aec3c73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (164d9d00-4079-41b6-bdd6-eb2f0488043e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (164d9d00-4079-41b6-bdd6-eb2f0488043e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938ece15-15e9-41f9-a7a5-d5b5672eb825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:10 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Volume c4358289-47fe-40df-b287-bf616e657307: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4358289-47fe-40df-b287-bf616e657307', 'volume_size': 1, 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41c991745fb845ed91d69be55aec3c73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Trying to clone c4358289-47fe-40df-b287-bf616e657307 from image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]). {{(pid=93530) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_s53o03lndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:19:10 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Image download 20.69 MB at 20.69 MB/s Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f58563a-f00c-4efc-9c84-77a84e8cd5b4]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_s53o03lndevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:10 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_s53o03lndevstack@QuobyteHD Jun 19 04:19:10 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:10 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.info" returned: 0 in 0.694s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.948s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.866s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-289807607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c5c7ea-1239-4467-bb64-14a271987bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43635d38731c4dda92c98ef0a431517b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:08Z,use_quota=True,user_id='9f742de85cb54cfb82564a6e699557d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23000d81-2fe0-48e6-ad50-5b515ae3cd03),volume_type_id=23000d81-2fe0-48e6-ad50-5b515ae3cd03)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Creating volume 35c5c7ea-1239-4467-bb64-14a271987bee {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:10 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:19:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-35c5c7ea-1239-4467-bb64-14a271987bee 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:10 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-35c5c7ea-1239-4467-bb64-14a271987bee 1073741824 Jun 19 04:19:10 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:10 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-5f399bc9-2ac3-4138-90e0-fdcd74285493 tempest-SnapshotMetadataTestJSON-724910099 None] Create snapshot completed successfully Jun 19 04:19:11 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_s53o03lndevstack@QuobyteHD" returned: 0 in 0.837s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:11 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Temporary image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 is fetched for user 0021778d61c64ffab2bedfa9ab983c57. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:19:11 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1831dd-cbcc-4cc7-a6b7-abbeb3c6ce35]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_s53o03lndevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:11 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_s53o03lndevstack@QuobyteHD Jun 19 04:19:11 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:11 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-35c5c7ea-1239-4467-bb64-14a271987bee 1073741824" returned: 0 in 1.028s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-35c5c7ea-1239-4467-bb64-14a271987bee {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Acquiring lock "cinder-2689f07f-268f-4d62-b88c-d4d11332e431-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:12 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-35c5c7ea-1239-4467-bb64-14a271987bee Jun 19 04:19:12 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Lock "cinder-2689f07f-268f-4d62-b88c-d4d11332e431-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Acquiring lock "cinder-quobyte-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Lock "cinder-quobyte-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Acquiring lock "cinder-quobyte-2689f07f-268f-4d62-b88c-d4d11332e431" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Lock "cinder-quobyte-2689f07f-268f-4d62-b88c-d4d11332e431" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Deleting offline snapshot 2689f07f-268f-4d62-b88c-d4d11332e431 of volume 9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] snapshot_file for this snap is: volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[854e71da-6fcb-4af7-bffc-53ba3c7b3fbe]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:12 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 Jun 19 04:19:12 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:12 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_s53o03lndevstack@QuobyteHD" returned: 0 in 0.864s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:12 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-35c5c7ea-1239-4467-bb64-14a271987bee" returned: 0 in 0.762s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.261s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1024654421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4358289-47fe-40df-b287-bf616e657307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acf7bd03c7454f07b72166bce92bb9ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:10Z,use_quota=True,user_id='0021778d61c64ffab2bedfa9ab983c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Creating volume c4358289-47fe-40df-b287-bf616e657307 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:12 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c237bed4-6f67-4f3a-906d-e017ebb4c224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c5c7ea-1239-4467-bb64-14a271987bee', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:12 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 1073741824 Jun 19 04:19:12 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd3c0ca-b669-4945-b59b-052f0bbc2b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:12 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Volume volume-35c5c7ea-1239-4467-bb64-14a271987bee (35c5c7ea-1239-4467-bb64-14a271987bee): created successfully Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd3c0ca-b669-4945-b59b-052f0bbc2b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Flow 'volume_create_manager' (6d5b1541-51d1-4d2d-8a38-09454f487db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:12 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-91477b8c-6818-4420-a17a-5656f1d63d10 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Created volume successfully. Jun 19 04:19:13 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431" returned: 0 in 0.881s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:19:13 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-c72fce6e-0b5c-44b2-8681-56252638d777 req-b728bc14-d773-46c9-805e-6b2f9e6d5abb tempest-AttachVolumeTestJSON-665193495 None] Terminate volume connection completed successfully. Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-c72fce6e-0b5c-44b2-8681-56252638d777 req-b728bc14-d773-46c9-805e-6b2f9e6d5abb tempest-AttachVolumeTestJSON-665193495 None] Deleting attachment d95f9810-c14c-49b8-8037-05faa1bfae63. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[5782bf83-d091-4dc5-b642-c99a68e3aa69]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:13 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 Jun 19 04:19:13 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a9ae9fab-e825-493d-96a2-cbf0d651fb8a tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a9ae9fab-e825-493d-96a2-cbf0d651fb8a tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a9ae9fab-e825-493d-96a2-cbf0d651fb8a tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a9ae9fab-e825-493d-96a2-cbf0d651fb8a tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a9ae9fab-e825-493d-96a2-cbf0d651fb8a tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a9ae9fab-e825-493d-96a2-cbf0d651fb8a tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:13 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:19:13 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:13 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 1073741824" returned: 0 in 1.097s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:13 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23" returned: 0 in 0.857s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:13 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 Jun 19 04:19:13 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:13 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 Jun 19 04:19:13 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:14 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a9ae9fab-e825-493d-96a2-cbf0d651fb8a tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.884s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:14 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-a9ae9fab-e825-493d-96a2-cbf0d651fb8a tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:14 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a9ae9fab-e825-493d-96a2-cbf0d651fb8a tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Retype volume completed successfully. Jun 19 04:19:14 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307" returned: 0 in 0.774s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:14 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:14 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Attempting download of 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}])) to volume c4358289-47fe-40df-b287-bf616e657307. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:19:14 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b571f26-1fcd-48ec-a732-38e9dfe6340d]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_h4nnmuqi {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:14 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431" returned: 0 in 0.895s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:14 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431 Jun 19 04:19:14 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Acquiring lock "cinder-35c5c7ea-1239-4467-bb64-14a271987bee-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Lock "cinder-35c5c7ea-1239-4467-bb64-14a271987bee-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:14 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_h4nnmuqi Jun 19 04:19:14 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Acquiring lock "cinder-quobyte-35c5c7ea-1239-4467-bb64-14a271987bee" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Lock "cinder-quobyte-35c5c7ea-1239-4467-bb64-14a271987bee" acquired by "delete_volume" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:15 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20cdb74-7b46-436f-a143-de29ccb00814]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-35c5c7ea-1239-4467-bb64-14a271987bee {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:15 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-35c5c7ea-1239-4467-bb64-14a271987bee Jun 19 04:19:15 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:15 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23.2689f07f-268f-4d62-b88c-d4d11332e431" returned: 0 in 0.740s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Lock "cinder-quobyte-2689f07f-268f-4d62-b88c-d4d11332e431" released by "_delete_snapshot" :: held 3.505s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Lock "cinder-quobyte-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23" released by "delete_snapshot" :: held 3.534s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:15 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_h4nnmuqi" returned: 0 in 0.833s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_h4nnmuqi {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:15 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Created reservations ['86c73072-480a-4bdb-87fa-fabc59202fd4', 'f1b768e5-c750-48a0-955e-e3bbddcb4eb6', 'c68c7e58-f97d-45f8-a793-c629542b201c', '5eec7089-c828-4105-a9da-181062ce7cba'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:15 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_h4nnmuqi Jun 19 04:19:15 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Delete snapshot completed successfully. Jun 19 04:19:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86a71111-d208-42b0-a2e3-216f3df1f3cf tempest-SnapshotMetadataTestJSON-724910099 None] Lock "cinder-2689f07f-268f-4d62-b88c-d4d11332e431-delete_snapshot" released by "delete_snapshot" :: held 3.873s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:16 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-35c5c7ea-1239-4467-bb64-14a271987bee" returned: 0 in 0.985s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-35c5c7ea-1239-4467-bb64-14a271987bee {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:16 devstack sudo[101260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-35c5c7ea-1239-4467-bb64-14a271987bee Jun 19 04:19:16 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Acquiring lock "cinder-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Lock "cinder-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Acquiring lock "cinder-quobyte-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Lock "cinder-quobyte-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23" acquired by "delete_volume" :: waited 0.026s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:16 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b5528f-0f0f-4fc5-8421-4f343ade91e5]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:16 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 Jun 19 04:19:16 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:16 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_h4nnmuqi" returned: 1 in 1.159s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_h4nnmuqi' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:19:16 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc97830b-f49c-4607-9f2f-d2705f0dae27]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_s53o03lndevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:16 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_s53o03lndevstack@QuobyteHD Jun 19 04:19:16 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:16 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-35c5c7ea-1239-4467-bb64-14a271987bee" returned: 0 in 0.964s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Lock "cinder-quobyte-35c5c7ea-1239-4467-bb64-14a271987bee" released by "delete_volume" :: held 2.005s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:17 devstack cinder-volume[93530]: WARNING cinder.quota [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:19:17 devstack cinder-volume[93530]: WARNING cinder.quota [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:19:17 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Created reservations ['2eb4b19a-fc0f-4d74-ac78-adef1a92d779', '39e940fa-3913-407c-8ed2-1f6319f6c9e9', 'b3d8c0da-b6bc-4637-b05f-fa65e1ac2796', '5ce13621-601c-4a34-ae29-16a2bb20e4d9'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:17 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:19:17 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:17 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23" returned: 0 in 0.921s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:17 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23 Jun 19 04:19:17 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:17 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_s53o03lndevstack@QuobyteHD" returned: 0 in 0.995s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:17 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 was qcow2, converting to raw {{(pid=93530) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:19:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_s53o03lndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:17 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_s53o03lndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 Jun 19 04:19:17 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:18 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.952s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:18 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:18 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Deleted volume successfully. Jun 19 04:19:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-81d3bec6-54a7-4dc2-910a-7b200cb1c175 tempest-VolumeRetypeWithoutMigrationTest-1662220747 None] Lock "cinder-35c5c7ea-1239-4467-bb64-14a271987bee-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:18 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23" returned: 0 in 0.985s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Lock "cinder-quobyte-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23" released by "delete_volume" :: held 1.977s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:18 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Created reservations ['4ee1ba61-f79b-4a1b-8569-b3eef4a078d3', '9a6c2396-1dfd-41cc-8817-6e9f8966b8d9', 'ba53e6aa-29dd-47ed-924f-229436ec99df', 'ff5f8467-7bdd-42c8-bf95-436a7eb2f9f2'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:18 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:19:18 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:19 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.887s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:19 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:19 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Deleted volume successfully. Jun 19 04:19:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f709d6e6-26f3-4e7b-9c12-860a793802df tempest-SnapshotMetadataTestJSON-724910099 None] Lock "cinder-9c8a1fe4-fb5a-4109-b707-d9ff1ac50e23-delete_volume" released by "delete_volume" :: held 3.184s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:20 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_s53o03lndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307" returned: 0 in 2.746s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:20 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_s53o03lndevstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:19:20 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Converted 112.00 MB image at 40.76 MB/s Jun 19 04:19:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:20 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 1G Jun 19 04:19:20 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:21 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 1G" returned: 0 in 0.813s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:21 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eea2fa-bf82-4509-8bdf-1eede5342239]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:21 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 Jun 19 04:19:21 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:22 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307" returned: 0 in 0.829s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:22 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 Jun 19 04:19:22 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:23 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307" returned: 1 in 0.850s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Downloaded image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}])) to volume c4358289-47fe-40df-b287-bf616e657307 successfully. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Temporary image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 for user 0021778d61c64ffab2bedfa9ab983c57 is deleted. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Marking volume c4358289-47fe-40df-b287-bf616e657307 as bootable. {{(pid=93530) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=101,cinder:DELETE=10,cinder:SELECT=91,cinder:INSERT=26 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Copying metadata from image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 to c4358289-47fe-40df-b287-bf616e657307. {{(pid=93530) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Creating volume glance metadata for volume c4358289-47fe-40df-b287-bf616e657307 backed by image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93530) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=91,cinder:UPDATE=108,cinder:INSERT=22,cinder:DELETE=7 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938ece15-15e9-41f9-a7a5-d5b5672eb825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4358289-47fe-40df-b287-bf616e657307', 'volume_size': 1, 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41c991745fb845ed91d69be55aec3c73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d701c78-47eb-4e81-85f9-045005c41a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:23 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Volume volume-c4358289-47fe-40df-b287-bf616e657307 (c4358289-47fe-40df-b287-bf616e657307): created successfully Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d701c78-47eb-4e81-85f9-045005c41a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Flow 'volume_create_manager' (11c1c4d9-282c-4520-a017-3c82bb69bba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:23 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-02171561-70d4-4e53-8fbe-1cd741678618 tempest-VolumesImageMetadata-1998202553 None] Created volume successfully. Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Flow 'volume_create_manager' (cf9fecff-29cb-4804-b455-f28c173fbd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f07fc87-dab4-41a7-b28d-eaae79dafb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f07fc87-dab4-41a7-b28d-eaae79dafb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-162426456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d448127d-d495-4614-8094-4f8a503b6dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa1c4ec08e6844afae15066cc58b9d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:24Z,use_quota=True,user_id='7b967b5049854c5b9be882ee364d08f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c0c8f0-6560-4612-8dab-e5a8d06f4333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c0c8f0-6560-4612-8dab-e5a8d06f4333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395d2ecb-96bd-408c-afa5-d041253c6126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395d2ecb-96bd-408c-afa5-d041253c6126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd448127d-d495-4614-8094-4f8a503b6dfe', 'volume_name': 'volume-d448127d-d495-4614-8094-4f8a503b6dfe', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17cad0be-9fec-4a7c-aa59-1842aaac5109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17cad0be-9fec-4a7c-aa59-1842aaac5109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cefdde3-14d2-42d9-acde-47a1f673134d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:23 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Volume d448127d-d495-4614-8094-4f8a503b6dfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d448127d-d495-4614-8094-4f8a503b6dfe', 'volume_size': 1} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-162426456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d448127d-d495-4614-8094-4f8a503b6dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa1c4ec08e6844afae15066cc58b9d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:24Z,use_quota=True,user_id='7b967b5049854c5b9be882ee364d08f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Creating volume d448127d-d495-4614-8094-4f8a503b6dfe {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:23 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:19:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d448127d-d495-4614-8094-4f8a503b6dfe 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:23 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d448127d-d495-4614-8094-4f8a503b6dfe 1073741824 Jun 19 04:19:23 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:24 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Acquiring lock "cinder-c4358289-47fe-40df-b287-bf616e657307-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:24 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Lock "cinder-c4358289-47fe-40df-b287-bf616e657307-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:24 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Acquiring lock "cinder-quobyte-c4358289-47fe-40df-b287-bf616e657307" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:24 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Lock "cinder-quobyte-c4358289-47fe-40df-b287-bf616e657307" acquired by "delete_volume" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:24 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f13510-880f-4c9b-8e56-1e196cd4bb37]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:24 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 Jun 19 04:19:24 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:24 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d448127d-d495-4614-8094-4f8a503b6dfe 1073741824" returned: 0 in 1.026s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d448127d-d495-4614-8094-4f8a503b6dfe {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:24 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d448127d-d495-4614-8094-4f8a503b6dfe Jun 19 04:19:24 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307" returned: 0 in 1.037s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:25 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:25 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 Jun 19 04:19:25 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:25 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d448127d-d495-4614-8094-4f8a503b6dfe" returned: 0 in 0.956s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:25 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cefdde3-14d2-42d9-acde-47a1f673134d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d448127d-d495-4614-8094-4f8a503b6dfe', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bf6794-c26f-4e2d-b96e-123bea1236e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:25 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Volume volume-d448127d-d495-4614-8094-4f8a503b6dfe (d448127d-d495-4614-8094-4f8a503b6dfe): created successfully Jun 19 04:19:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74bf6794-c26f-4e2d-b96e-123bea1236e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Flow 'volume_create_manager' (cf9fecff-29cb-4804-b455-f28c173fbd36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:25 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-b6093c7c-e15f-4a3e-8ccd-26896a5d3b79 tempest-AbsoluteLimitsTests-1226088630 None] Created volume successfully. Jun 19 04:19:26 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307" returned: 1 in 0.869s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:19:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:26 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307 Jun 19 04:19:26 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Acquiring lock "cinder-d448127d-d495-4614-8094-4f8a503b6dfe-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Lock "cinder-d448127d-d495-4614-8094-4f8a503b6dfe-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Acquiring lock "cinder-quobyte-d448127d-d495-4614-8094-4f8a503b6dfe" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Lock "cinder-quobyte-d448127d-d495-4614-8094-4f8a503b6dfe" acquired by "delete_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e13f9f9-976c-4508-8f6a-c4f0813f2676]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d448127d-d495-4614-8094-4f8a503b6dfe {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:27 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c4358289-47fe-40df-b287-bf616e657307" returned: 0 in 0.864s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Lock "cinder-quobyte-c4358289-47fe-40df-b287-bf616e657307" released by "delete_volume" :: held 2.846s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:27 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d448127d-d495-4614-8094-4f8a503b6dfe Jun 19 04:19:27 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Created reservations ['fa409342-af2b-462e-83a8-20acc9b55378', 'c45f1411-d343-4fa9-8c49-3213a76d5a6e', '94095169-d348-4549-96dc-425874e01a95', '8f100867-da63-44ef-b2a6-a0ff84815b67'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:27 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:19:27 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:29 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d448127d-d495-4614-8094-4f8a503b6dfe" returned: 0 in 1.895s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d448127d-d495-4614-8094-4f8a503b6dfe {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:29 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d448127d-d495-4614-8094-4f8a503b6dfe Jun 19 04:19:29 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:29 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.644s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:29 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:29 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Deleted volume successfully. Jun 19 04:19:29 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a1b8d631-bb52-4a5b-b546-6cbdcb1dddeb tempest-VolumesImageMetadata-1998202553 None] Lock "cinder-c4358289-47fe-40df-b287-bf616e657307-delete_volume" released by "delete_volume" :: held 4.988s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:30 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d448127d-d495-4614-8094-4f8a503b6dfe" returned: 0 in 0.970s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:30 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Lock "cinder-quobyte-d448127d-d495-4614-8094-4f8a503b6dfe" released by "delete_volume" :: held 2.963s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:30 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Created reservations ['9de01fd4-cf1b-4c82-b057-96bbba932ce6', 'fc3a40be-08d8-4d16-bdfd-348c623a9fd5', 'c25e3fcc-36b5-4ec4-b3fd-24e33ff78fe7', '2cfef6e6-30f0-4e33-8ceb-bf978865d3f2'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:30 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:30 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:30 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:19:30 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:31 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.157s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:31 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:31 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Deleted volume successfully. Jun 19 04:19:31 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e56347cc-e8d7-41f4-89f3-72cc02bb0880 tempest-AbsoluteLimitsTests-1226088630 None] Lock "cinder-d448127d-d495-4614-8094-4f8a503b6dfe-delete_volume" released by "delete_volume" :: held 4.493s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Flow 'volume_create_manager' (4cbe0b3e-3fac-4168-b92b-8e2aced81d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7768a2e7-3fd6-4609-8ae2-577d2de30ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7768a2e7-3fd6-4609-8ae2-577d2de30ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1495966511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecfb92c-f4d5-4e07-a011-2af1846098d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d861c34f0ac649b3b214bd639604bd70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:36Z,use_quota=True,user_id='8b423439d24744e399554a27bc9e1482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5433a0b-09a7-46b9-a925-df26ca491469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5433a0b-09a7-46b9-a925-df26ca491469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc8aa47-6a99-4aef-9934-7e8df0d5aa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc8aa47-6a99-4aef-9934-7e8df0d5aa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ecfb92c-f4d5-4e07-a011-2af1846098d4', 'volume_name': 'volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc7d94f-422c-40c6-bff6-bddbe5819660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc7d94f-422c-40c6-bff6-bddbe5819660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6a76f2-a348-40d1-92e7-29ffeb9e12a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:36 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Volume 1ecfb92c-f4d5-4e07-a011-2af1846098d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4', 'volume_size': 1} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1495966511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecfb92c-f4d5-4e07-a011-2af1846098d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d861c34f0ac649b3b214bd639604bd70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:36Z,use_quota=True,user_id='8b423439d24744e399554a27bc9e1482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Creating volume 1ecfb92c-f4d5-4e07-a011-2af1846098d4 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:36 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:19:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:36 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4 1073741824 Jun 19 04:19:36 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:37 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Flow 'volume_create_manager' (d48a3065-1391-49b3-9dd7-0c5f6b6bf829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546f9d9f-820b-43c2-a01a-8ba2ad10c064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (546f9d9f-820b-43c2-a01a-8ba2ad10c064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-205930226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38115333-34bc-40dc-b87b-efc5fbab637d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9033afb5244edb9e922642d6d91b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:38Z,use_quota=True,user_id='6316d37204114773a94c1452c0564e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9cda19-bc78-48b9-95c5-6a4ef70ba4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9cda19-bc78-48b9-95c5-6a4ef70ba4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cff0a48-ddbe-4085-b43c-7e03b1509095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cff0a48-ddbe-4085-b43c-7e03b1509095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38115333-34bc-40dc-b87b-efc5fbab637d', 'volume_name': 'volume-38115333-34bc-40dc-b87b-efc5fbab637d', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724939e3-537a-4a2d-9099-002b314eae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724939e3-537a-4a2d-9099-002b314eae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd12851c-5e05-479e-9f4d-96141c63c466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:38 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Volume 38115333-34bc-40dc-b87b-efc5fbab637d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38115333-34bc-40dc-b87b-efc5fbab637d', 'volume_size': 1} Jun 19 04:19:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:38 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4 1073741824" returned: 0 in 1.442s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:38 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4 Jun 19 04:19:38 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:39 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4" returned: 0 in 0.817s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] <== create_volume: return (2330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.014s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-205930226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38115333-34bc-40dc-b87b-efc5fbab637d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9033afb5244edb9e922642d6d91b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:38Z,use_quota=True,user_id='6316d37204114773a94c1452c0564e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Creating volume 38115333-34bc-40dc-b87b-efc5fbab637d {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:39 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:39 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d 1073741824 Jun 19 04:19:39 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a6a76f2-a348-40d1-92e7-29ffeb9e12a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde93954-55e9-4262-aa00-0ec193fdae48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:39 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Volume volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4 (1ecfb92c-f4d5-4e07-a011-2af1846098d4): created successfully Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde93954-55e9-4262-aa00-0ec193fdae48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Flow 'volume_create_manager' (4cbe0b3e-3fac-4168-b92b-8e2aced81d93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:39 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-88e531f5-b868-4833-927f-76daa7da0990 tempest-VolumesTransfersTest-1896509141 None] Created volume successfully. Jun 19 04:19:40 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d 1073741824" returned: 0 in 1.184s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:40 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d Jun 19 04:19:40 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:40 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-19b2e004-945e-4ebe-b081-33e7abace2ae tempest-VolumesTransfersTest-430801053 None] Transfer volume completed successfully. Jun 19 04:19:41 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d" returned: 0 in 0.961s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] <== create_volume: return (2193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.196s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd12851c-5e05-479e-9f4d-96141c63c466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38115333-34bc-40dc-b87b-efc5fbab637d', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e828f2-fc50-4ddb-857a-322dc145cc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:41 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Volume volume-38115333-34bc-40dc-b87b-efc5fbab637d (38115333-34bc-40dc-b87b-efc5fbab637d): created successfully Jun 19 04:19:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58e828f2-fc50-4ddb-857a-322dc145cc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Flow 'volume_create_manager' (d48a3065-1391-49b3-9dd7-0c5f6b6bf829) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:41 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d105689c-a2d1-4079-a9e8-c9e683b8f7d8 tempest-VolumesDeleteCascade-571225804 None] Created volume successfully. Jun 19 04:19:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Acquiring lock "cinder-1ecfb92c-f4d5-4e07-a011-2af1846098d4-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Lock "cinder-1ecfb92c-f4d5-4e07-a011-2af1846098d4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Acquiring lock "cinder-quobyte-1ecfb92c-f4d5-4e07-a011-2af1846098d4" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Lock "cinder-quobyte-1ecfb92c-f4d5-4e07-a011-2af1846098d4" acquired by "delete_volume" :: waited 0.032s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:42 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[261478f2-2884-4158-a1f9-f8523283457f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:42 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4 Jun 19 04:19:42 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:42 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] Creating offline snapshot d7ee6dec-ed20-44d3-a4c3-2ad092742a6d of volume 38115333-34bc-40dc-b87b-efc5fbab637d {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:19:42 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcf6821-2974-4683-b34a-d9bfef02a567]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:42 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d Jun 19 04:19:42 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:43 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4" returned: 0 in 0.931s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:43 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4 Jun 19 04:19:43 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:43 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d" returned: 0 in 1.023s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:43 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d 1G Jun 19 04:19:43 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:43 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ecfb92c-f4d5-4e07-a011-2af1846098d4" returned: 0 in 0.815s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Lock "cinder-quobyte-1ecfb92c-f4d5-4e07-a011-2af1846098d4" released by "delete_volume" :: held 1.827s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:44 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Created reservations ['263f597c-3431-4318-bf57-bbe5aa7b4f47', '8a8d2292-65fa-4f84-84f3-e3c700c5fbb1', '5dc06f2c-87df-46af-babd-7e753b967014', 'e8905821-8833-4e09-82d2-9a1b164e7c5c'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:44 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:19:44 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:44 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d 1G" returned: 0 in 1.106s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38115333-34bc-40dc-b87b-efc5fbab637d -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:44 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38115333-34bc-40dc-b87b-efc5fbab637d -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d Jun 19 04:19:44 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Flow 'volume_create_manager' (6588d95f-5518-40eb-9ab3-c3f99ee2bbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e80f5e8-e27a-429f-b7d8-0b1a766b78a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e80f5e8-e27a-429f-b7d8-0b1a766b78a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-387675427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e018a0e-de13-44dd-8af5-2788b161f6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d861c34f0ac649b3b214bd639604bd70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:45Z,use_quota=True,user_id='8b423439d24744e399554a27bc9e1482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b89b23-5ee6-47d3-9dab-7cfacad02f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:45 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b89b23-5ee6-47d3-9dab-7cfacad02f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9bff81-75b2-4cc9-8d4f-bbc27473d245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9bff81-75b2-4cc9-8d4f-bbc27473d245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e018a0e-de13-44dd-8af5-2788b161f6b2', 'volume_name': 'volume-1e018a0e-de13-44dd-8af5-2788b161f6b2', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d8c9dd-7188-4897-9b3c-9de8cf81e1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d8c9dd-7188-4897-9b3c-9de8cf81e1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c374eb0b-5584-4b6c-9165-8df87a293b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:45 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Volume 1e018a0e-de13-44dd-8af5-2788b161f6b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e018a0e-de13-44dd-8af5-2788b161f6b2', 'volume_size': 1} Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.945s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:45 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Deleted volume successfully. Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-17f82fa8-a6da-4e83-8342-77aa5c38e95f tempest-VolumesTransfersTest-814065836 None] Lock "cinder-1ecfb92c-f4d5-4e07-a011-2af1846098d4-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:45 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38115333-34bc-40dc-b87b-efc5fbab637d -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d" returned: 0 in 0.994s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:45 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d is being set with open permissions: ugo+rw Jun 19 04:19:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:45 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d Jun 19 04:19:45 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:46 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d" returned: 0 in 0.691s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:46 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.info Jun 19 04:19:46 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:47 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.info" returned: 0 in 0.669s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:47 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.info is being set with open permissions: ugo+rw Jun 19 04:19:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:47 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.info Jun 19 04:19:47 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:47 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.info" returned: 0 in 0.658s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.268s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.653s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-387675427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e018a0e-de13-44dd-8af5-2788b161f6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d861c34f0ac649b3b214bd639604bd70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:45Z,use_quota=True,user_id='8b423439d24744e399554a27bc9e1482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Creating volume 1e018a0e-de13-44dd-8af5-2788b161f6b2 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:47 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:19:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1e018a0e-de13-44dd-8af5-2788b161f6b2 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:47 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1e018a0e-de13-44dd-8af5-2788b161f6b2 1073741824 Jun 19 04:19:47 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:47 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-cad0ab86-a791-428e-b4b9-bf3ec9d9a7a7 tempest-VolumesDeleteCascade-571225804 None] Create snapshot completed successfully Jun 19 04:19:48 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1e018a0e-de13-44dd-8af5-2788b161f6b2 1073741824" returned: 0 in 1.000s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1e018a0e-de13-44dd-8af5-2788b161f6b2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:48 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1e018a0e-de13-44dd-8af5-2788b161f6b2 Jun 19 04:19:48 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:49 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1e018a0e-de13-44dd-8af5-2788b161f6b2" returned: 0 in 0.858s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.478s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] Creating offline snapshot b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 of volume 38115333-34bc-40dc-b87b-efc5fbab637d {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:19:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c374eb0b-5584-4b6c-9165-8df87a293b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e018a0e-de13-44dd-8af5-2788b161f6b2', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606c556c-a9fa-4ee8-91c7-549ba9f9e848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:49 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cee145d-6e1e-437a-94ae-1a71b3d88101]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:49 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Volume volume-1e018a0e-de13-44dd-8af5-2788b161f6b2 (1e018a0e-de13-44dd-8af5-2788b161f6b2): created successfully Jun 19 04:19:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606c556c-a9fa-4ee8-91c7-549ba9f9e848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Flow 'volume_create_manager' (6588d95f-5518-40eb-9ab3-c3f99ee2bbd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:49 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-cae8a2cd-62ff-41ae-9f46-c07fe587c954 tempest-VolumesTransfersTest-1896509141 None] Created volume successfully. Jun 19 04:19:49 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d Jun 19 04:19:49 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Acquiring lock "cinder-1e018a0e-de13-44dd-8af5-2788b161f6b2-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:50 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d" returned: 0 in 0.988s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38115333-34bc-40dc-b87b-efc5fbab637d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:19:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Lock "cinder-1e018a0e-de13-44dd-8af5-2788b161f6b2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:50 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 1G Jun 19 04:19:50 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Acquiring lock "cinder-quobyte-1e018a0e-de13-44dd-8af5-2788b161f6b2" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Lock "cinder-quobyte-1e018a0e-de13-44dd-8af5-2788b161f6b2" acquired by "delete_volume" :: waited 0.015s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:50 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e30b4f0-7dc0-4e41-878c-bd906646f24a]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1e018a0e-de13-44dd-8af5-2788b161f6b2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:51 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1e018a0e-de13-44dd-8af5-2788b161f6b2 Jun 19 04:19:51 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:51 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1e018a0e-de13-44dd-8af5-2788b161f6b2" returned: 0 in 0.894s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1e018a0e-de13-44dd-8af5-2788b161f6b2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:51 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1e018a0e-de13-44dd-8af5-2788b161f6b2 Jun 19 04:19:51 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:51 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 1G" returned: 0 in 1.186s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:51 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 Jun 19 04:19:51 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:52 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1e018a0e-de13-44dd-8af5-2788b161f6b2" returned: 0 in 0.836s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Lock "cinder-quobyte-1e018a0e-de13-44dd-8af5-2788b161f6b2" released by "delete_volume" :: held 1.787s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:52 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Created reservations ['5dc7c3a1-a124-4d37-a3c3-5771edf956f9', 'e37d4554-a4dc-4ecf-a0bc-fc7b360ac8dd', '6266a318-8b40-42ad-a1cd-232174be5fee', '016e20ea-b006-47e7-a786-2f88bbc7778d'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:52 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052" returned: 0 in 0.876s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:52 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 is being set with open permissions: ugo+rw Jun 19 04:19:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:52 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:19:52 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:52 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 Jun 19 04:19:52 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:53 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.951s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:53 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:53 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Deleted volume successfully. Jun 19 04:19:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e75a824d-e51c-4685-9d9f-831f9863029a tempest-VolumesTransfersTest-814065836 None] Lock "cinder-1e018a0e-de13-44dd-8af5-2788b161f6b2-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:54 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052" returned: 0 in 1.299s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.507s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:54 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-cbb6edd0-71cd-4cc3-ae69-9a455881294d tempest-VolumesDeleteCascade-571225804 None] Create snapshot completed successfully Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-38115333-34bc-40dc-b87b-efc5fbab637d-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-38115333-34bc-40dc-b87b-efc5fbab637d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Performing cascade delete. {{(pid=93530) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-b3e9ed10-4eed-4882-8ac9-fe71f8e4f052-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-b3e9ed10-4eed-4882-8ac9-fe71f8e4f052-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-quobyte-38115333-34bc-40dc-b87b-efc5fbab637d" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-38115333-34bc-40dc-b87b-efc5fbab637d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-quobyte-b3e9ed10-4eed-4882-8ac9-fe71f8e4f052" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-b3e9ed10-4eed-4882-8ac9-fe71f8e4f052" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Deleting offline snapshot b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 of volume 38115333-34bc-40dc-b87b-efc5fbab637d {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] snapshot_file for this snap is: volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb9d9d2-82d6-47f7-ae62-7f16abd4df6b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:55 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 Jun 19 04:19:55 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:56 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052" returned: 0 in 1.319s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38115333-34bc-40dc-b87b-efc5fbab637d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:19:56 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[532dfb84-cdd8-4d09-884e-3fa509ea533a]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:56 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d Jun 19 04:19:56 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:57 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d" returned: 0 in 1.137s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38115333-34bc-40dc-b87b-efc5fbab637d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:19:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:57 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 Jun 19 04:19:57 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:58 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052" returned: 0 in 1.212s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:58 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052 Jun 19 04:19:58 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:19:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:58 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:19:58 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:59 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.765s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:19:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:19:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:19:59 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.b3e9ed10-4eed-4882-8ac9-fe71f8e4f052" returned: 0 in 1.122s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-b3e9ed10-4eed-4882-8ac9-fe71f8e4f052" released by "_delete_snapshot" :: held 4.985s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-38115333-34bc-40dc-b87b-efc5fbab637d" released by "delete_snapshot" :: held 5.055s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:59 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Created reservations ['ec336708-27b1-47cb-a83f-b19cf9ca8b0b', '250a3e20-27ad-450e-9b23-59a3006891cf', 'a493a021-fe52-458e-9d9e-966b12b9b93a', '3522c636-9928-4aed-965d-8c65235f125e'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:59 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Delete snapshot completed successfully. Jun 19 04:19:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-b3e9ed10-4eed-4882-8ac9-fe71f8e4f052-delete_snapshot" released by "delete_snapshot" :: held 5.268s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-d7ee6dec-ed20-44d3-a4c3-2ad092742a6d-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-d7ee6dec-ed20-44d3-a4c3-2ad092742a6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-quobyte-38115333-34bc-40dc-b87b-efc5fbab637d" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-38115333-34bc-40dc-b87b-efc5fbab637d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-quobyte-d7ee6dec-ed20-44d3-a4c3-2ad092742a6d" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-d7ee6dec-ed20-44d3-a4c3-2ad092742a6d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Deleting offline snapshot d7ee6dec-ed20-44d3-a4c3-2ad092742a6d of volume 38115333-34bc-40dc-b87b-efc5fbab637d {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:20:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] snapshot_file for this snap is: volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:20:00 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[14393514-f70e-409c-b959-7ebc0e437510]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:00 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d Jun 19 04:20:00 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:00 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d" returned: 0 in 0.830s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38115333-34bc-40dc-b87b-efc5fbab637d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:20:01 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5374d54-86d0-4d11-8723-92611c19179b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:01 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d Jun 19 04:20:01 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:01 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d" returned: 0 in 0.924s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:01 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d Jun 19 04:20:01 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:02 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d" returned: 0 in 0.891s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:02 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d Jun 19 04:20:02 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Flow 'volume_create_manager' (6e8dfb59-3cc8-4466-950a-a8813a33157f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f14894e-fff3-40da-9851-547be3f9e324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f14894e-fff3-40da-9851-547be3f9e324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2101393188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9764ce-439e-4d0b-8ed7-099b27328c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6802ae13d684922956d2799e38e44f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:03Z,use_quota=True,user_id='79a28bb2fa2b447baadc4852f178e2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903ddf87-d113-46a9-b42e-c335f6b40976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (903ddf87-d113-46a9-b42e-c335f6b40976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f91705-746d-442b-bcce-03998115a650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f91705-746d-442b-bcce-03998115a650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b9764ce-439e-4d0b-8ed7-099b27328c58', 'volume_name': 'volume-1b9764ce-439e-4d0b-8ed7-099b27328c58', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883a4865-c0ee-401f-8a36-c89bdbdda823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883a4865-c0ee-401f-8a36-c89bdbdda823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b174c6c-7fa9-4b60-83de-afee6ce20ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:03 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Volume 1b9764ce-439e-4d0b-8ed7-099b27328c58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b9764ce-439e-4d0b-8ed7-099b27328c58', 'volume_size': 1} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2101393188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9764ce-439e-4d0b-8ed7-099b27328c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6802ae13d684922956d2799e38e44f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:03Z,use_quota=True,user_id='79a28bb2fa2b447baadc4852f178e2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Creating volume 1b9764ce-439e-4d0b-8ed7-099b27328c58 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:03 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b9764ce-439e-4d0b-8ed7-099b27328c58 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:03 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b9764ce-439e-4d0b-8ed7-099b27328c58 1073741824 Jun 19 04:20:03 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:03 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d.d7ee6dec-ed20-44d3-a4c3-2ad092742a6d" returned: 0 in 0.803s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-d7ee6dec-ed20-44d3-a4c3-2ad092742a6d" released by "_delete_snapshot" :: held 3.585s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-38115333-34bc-40dc-b87b-efc5fbab637d" released by "delete_snapshot" :: held 3.617s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Created reservations ['15b63abf-048d-4b2d-bfba-4681ac351dfb', 'b41baf7a-e8c7-4796-ab93-76aab39767f7', 'a4e10dcc-e501-4b11-aaa4-c275b35c9dc7', 'd0e873c7-e4ea-465f-97ad-da1f7021b831'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:03 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Delete snapshot completed successfully. Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-d7ee6dec-ed20-44d3-a4c3-2ad092742a6d-delete_snapshot" released by "delete_snapshot" :: held 3.816s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Snapshots deleted, issuing volume delete {{(pid=93530) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-quobyte-38115333-34bc-40dc-b87b-efc5fbab637d" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-38115333-34bc-40dc-b87b-efc5fbab637d" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[b986bd7f-f7cd-431b-8197-1d78cd84ed02]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:04 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d Jun 19 04:20:04 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:04 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b9764ce-439e-4d0b-8ed7-099b27328c58 1073741824" returned: 0 in 1.056s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b9764ce-439e-4d0b-8ed7-099b27328c58 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:04 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b9764ce-439e-4d0b-8ed7-099b27328c58 Jun 19 04:20:04 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:04 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d" returned: 0 in 0.969s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:04 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d Jun 19 04:20:04 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:05 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b9764ce-439e-4d0b-8ed7-099b27328c58" returned: 0 in 0.848s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b174c6c-7fa9-4b60-83de-afee6ce20ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b9764ce-439e-4d0b-8ed7-099b27328c58', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c891fc-19c6-4ca7-bd3d-e833bdcdf345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:05 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Volume volume-1b9764ce-439e-4d0b-8ed7-099b27328c58 (1b9764ce-439e-4d0b-8ed7-099b27328c58): created successfully Jun 19 04:20:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c891fc-19c6-4ca7-bd3d-e833bdcdf345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Flow 'volume_create_manager' (6e8dfb59-3cc8-4466-950a-a8813a33157f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:05 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-6cff7c10-a73f-41a5-8242-59a359167ca0 tempest-VolumesTransfersV355Test-402854834 None] Created volume successfully. Jun 19 04:20:05 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-38115333-34bc-40dc-b87b-efc5fbab637d" returned: 0 in 0.970s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:05 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-38115333-34bc-40dc-b87b-efc5fbab637d" released by "delete_volume" :: held 2.007s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:05 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Created reservations ['158ab829-4070-489c-9fdc-80c03279c895', '115dd743-eb2d-47a0-a443-415b47e3737f', '527258b0-914d-4f1e-998f-ed335fe6ca8e', 'c68fb5b0-647a-459e-b76b-25ad639a3e5e'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:06 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:20:06 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:06 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.852s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:06 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:06 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Deleted volume successfully. Jun 19 04:20:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d93cd08c-c951-41ce-a366-54fb4372ffb9 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-38115333-34bc-40dc-b87b-efc5fbab637d-delete_volume" released by "delete_volume" :: held 12.355s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:07 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ab4ff5bb-d2d6-4ca4-a694-a813566387ef tempest-VolumesTransfersV355Test-1330934479 None] Transfer volume completed successfully. Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Flow 'volume_create_manager' (fb16e263-e6be-4b0e-8c58-fa7cf0555511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ffed9b-4f33-467d-95a9-2655b6f9e714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ffed9b-4f33-467d-95a9-2655b6f9e714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1619909413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b78dff-b80b-4387-b5be-0bbcea81c647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9033afb5244edb9e922642d6d91b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:08Z,use_quota=True,user_id='6316d37204114773a94c1452c0564e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba5f97c-8d66-4ad8-9c69-2160274f8ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bba5f97c-8d66-4ad8-9c69-2160274f8ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5776f354-07ec-40d5-b8a4-45cdd72194d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5776f354-07ec-40d5-b8a4-45cdd72194d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8b78dff-b80b-4387-b5be-0bbcea81c647', 'volume_name': 'volume-b8b78dff-b80b-4387-b5be-0bbcea81c647', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac57375-9ead-4064-88d6-2d0381dc0ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac57375-9ead-4064-88d6-2d0381dc0ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee51dfe4-1f32-4f08-a25c-ad1f2755d9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:07 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Volume b8b78dff-b80b-4387-b5be-0bbcea81c647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8b78dff-b80b-4387-b5be-0bbcea81c647', 'volume_size': 1} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1619909413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b78dff-b80b-4387-b5be-0bbcea81c647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9033afb5244edb9e922642d6d91b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:08Z,use_quota=True,user_id='6316d37204114773a94c1452c0564e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Creating volume b8b78dff-b80b-4387-b5be-0bbcea81c647 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:07 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:20:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:07 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 1073741824 Jun 19 04:20:07 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Acquiring lock "cinder-1b9764ce-439e-4d0b-8ed7-099b27328c58-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Lock "cinder-1b9764ce-439e-4d0b-8ed7-099b27328c58-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Acquiring lock "cinder-quobyte-1b9764ce-439e-4d0b-8ed7-099b27328c58" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Lock "cinder-quobyte-1b9764ce-439e-4d0b-8ed7-099b27328c58" acquired by "delete_volume" :: waited 0.014s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:08 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff446ab8-2bd9-4c3a-903c-7450d444fc77]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b9764ce-439e-4d0b-8ed7-099b27328c58 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:08 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b9764ce-439e-4d0b-8ed7-099b27328c58 Jun 19 04:20:08 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:08 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 1073741824" returned: 0 in 1.116s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:09 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 Jun 19 04:20:09 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:09 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b9764ce-439e-4d0b-8ed7-099b27328c58" returned: 0 in 0.859s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b9764ce-439e-4d0b-8ed7-099b27328c58 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:09 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b9764ce-439e-4d0b-8ed7-099b27328c58 Jun 19 04:20:09 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:09 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647" returned: 0 in 0.740s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee51dfe4-1f32-4f08-a25c-ad1f2755d9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b78dff-b80b-4387-b5be-0bbcea81c647', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedf8898-a41c-4945-bd3f-5fdde197ada9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:09 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Volume volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 (b8b78dff-b80b-4387-b5be-0bbcea81c647): created successfully Jun 19 04:20:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bedf8898-a41c-4945-bd3f-5fdde197ada9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Flow 'volume_create_manager' (fb16e263-e6be-4b0e-8c58-fa7cf0555511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:09 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-6276337c-9a98-4b09-a0f9-98c5fd885b41 tempest-VolumesDeleteCascade-571225804 None] Created volume successfully. Jun 19 04:20:10 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b9764ce-439e-4d0b-8ed7-099b27328c58" returned: 0 in 0.770s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Lock "cinder-quobyte-1b9764ce-439e-4d0b-8ed7-099b27328c58" released by "delete_volume" :: held 1.667s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:10 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Created reservations ['4f90645f-3ba4-4cf7-bc52-2780156d4952', '041b8d06-162a-4863-8a8d-f5b42a2b2906', '03053cd4-da19-462d-8427-85405def348c', '3848583b-8556-4d34-90f5-355a6349872e'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:10 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:20:10 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:10 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.716s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:11 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Deleted volume successfully. Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7cdfaa5a-88a9-4eae-ac22-18ea213aa5cd tempest-VolumesTransfersV355Test-874309031 None] Lock "cinder-1b9764ce-439e-4d0b-8ed7-099b27328c58-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Flow 'volume_create_manager' (4b19fd95-84de-4c82-836f-044fb3d74c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd5303e-63ef-4a0b-9e84-52c103cff1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] Creating offline snapshot ea4453da-fe19-4767-b282-74069604c6f4 of volume b8b78dff-b80b-4387-b5be-0bbcea81c647 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd5303e-63ef-4a0b-9e84-52c103cff1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2135720206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b26575f-1f8a-49fc-bd68-fed100f030b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6802ae13d684922956d2799e38e44f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:11Z,use_quota=True,user_id='79a28bb2fa2b447baadc4852f178e2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85a09ee-d74c-4301-a47f-07ee2e9546d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85a09ee-d74c-4301-a47f-07ee2e9546d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7caf772a-0503-4c02-89e1-2e3d57955dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7caf772a-0503-4c02-89e1-2e3d57955dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b26575f-1f8a-49fc-bd68-fed100f030b6', 'volume_name': 'volume-1b26575f-1f8a-49fc-bd68-fed100f030b6', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f56ff85-80af-43c2-beb8-dc40f27f1fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f56ff85-80af-43c2-beb8-dc40f27f1fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcf62bc-d02f-47ce-bd30-9942f524b5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:11 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Volume 1b26575f-1f8a-49fc-bd68-fed100f030b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b26575f-1f8a-49fc-bd68-fed100f030b6', 'volume_size': 1} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cca07d-cb69-417b-8c84-0eb586086a80]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:11 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 Jun 19 04:20:11 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:12 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647" returned: 0 in 0.839s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:12 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 1G Jun 19 04:20:12 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:13 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 1G" returned: 0 in 1.067s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:13 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 Jun 19 04:20:13 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:15 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4" returned: 0 in 1.652s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:15 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 is being set with open permissions: ugo+rw Jun 19 04:20:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:15 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 Jun 19 04:20:15 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:16 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4" returned: 0 in 0.929s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:16 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.info Jun 19 04:20:16 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:17 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.info" returned: 0 in 0.896s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:17 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.info is being set with open permissions: ugo+rw Jun 19 04:20:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:17 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.info Jun 19 04:20:17 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:17 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Flow 'volume_create_manager' (ebc54cea-4ba0-4bd7-8cd2-3fd25be34d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82fe9a7-142e-4b32-b169-bebeff154409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82fe9a7-142e-4b32-b169-bebeff154409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1343184574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617de629-b27d-49df-aa90-e8238b909df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3f49110e02454ba7b4fa9fdf71685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:17Z,use_quota=True,user_id='3fcfd592f4694c9c9169313990eb4b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c376ca-3a74-4766-a56b-c0bc52e7adc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c376ca-3a74-4766-a56b-c0bc52e7adc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b41174d-f899-452f-a8f8-071381089d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b41174d-f899-452f-a8f8-071381089d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '617de629-b27d-49df-aa90-e8238b909df6', 'volume_name': 'volume-617de629-b27d-49df-aa90-e8238b909df6', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5a6599-db46-4b62-89a9-0829518f11dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5a6599-db46-4b62-89a9-0829518f11dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306319ca-d8c3-4a89-aaac-a28c0ee353b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:17 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Volume 617de629-b27d-49df-aa90-e8238b909df6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-617de629-b27d-49df-aa90-e8238b909df6', 'volume_size': 1} Jun 19 04:20:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:18 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.info" returned: 0 in 0.944s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.516s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.419s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2135720206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b26575f-1f8a-49fc-bd68-fed100f030b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6802ae13d684922956d2799e38e44f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:11Z,use_quota=True,user_id='79a28bb2fa2b447baadc4852f178e2f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Creating volume 1b26575f-1f8a-49fc-bd68-fed100f030b6 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:18 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:20:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b26575f-1f8a-49fc-bd68-fed100f030b6 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:18 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b26575f-1f8a-49fc-bd68-fed100f030b6 1073741824 Jun 19 04:20:18 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:18 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-6fee879e-e900-4844-ac56-cbb8495736a2 tempest-VolumesDeleteCascade-571225804 None] Create snapshot completed successfully Jun 19 04:20:19 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b26575f-1f8a-49fc-bd68-fed100f030b6 1073741824" returned: 0 in 0.992s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b26575f-1f8a-49fc-bd68-fed100f030b6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:19 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b26575f-1f8a-49fc-bd68-fed100f030b6 Jun 19 04:20:19 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Flow 'volume_create_manager' (2f2d3848-f9f1-4cb4-ab35-a74714ee7deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e8cb0d-bf2a-4acc-ae1c-d2d1001dde5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e8cb0d-bf2a-4acc-ae1c-d2d1001dde5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1481680159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0626b2fa-91d8-462b-b4ef-4cf6a6bf0002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e9033afb5244edb9e922642d6d91b68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ea4453da-fe19-4767-b282-74069604c6f4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:20Z,use_quota=True,user_id='6316d37204114773a94c1452c0564e4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb088b2-de6e-4764-ab28-8de9b7f3ce74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb088b2-de6e-4764-ab28-8de9b7f3ce74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a022f56c-5e69-4dbe-8f56-547dceb5459b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a022f56c-5e69-4dbe-8f56-547dceb5459b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0626b2fa-91d8-462b-b4ef-4cf6a6bf0002', 'volume_name': 'volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002', 'volume_size': 1, 'snapshot_id': 'ea4453da-fe19-4767-b282-74069604c6f4'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d79756-fcbe-4d1b-967f-3ddb983efc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d79756-fcbe-4d1b-967f-3ddb983efc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6163d922-1b5e-4434-b475-3bc96a260154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:19 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Volume 0626b2fa-91d8-462b-b4ef-4cf6a6bf0002: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002', 'volume_size': 1, 'snapshot_id': 'ea4453da-fe19-4767-b282-74069604c6f4'} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:19 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b26575f-1f8a-49fc-bd68-fed100f030b6" returned: 0 in 0.860s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.334s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1343184574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617de629-b27d-49df-aa90-e8238b909df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3f49110e02454ba7b4fa9fdf71685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:17Z,use_quota=True,user_id='3fcfd592f4694c9c9169313990eb4b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Creating volume 617de629-b27d-49df-aa90-e8238b909df6 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:20 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:20:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-617de629-b27d-49df-aa90-e8238b909df6 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bcf62bc-d02f-47ce-bd30-9942f524b5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b26575f-1f8a-49fc-bd68-fed100f030b6', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2805a8a5-7894-4631-89cd-cab647ef14b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:20 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-617de629-b27d-49df-aa90-e8238b909df6 1073741824 Jun 19 04:20:20 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:20 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Volume volume-1b26575f-1f8a-49fc-bd68-fed100f030b6 (1b26575f-1f8a-49fc-bd68-fed100f030b6): created successfully Jun 19 04:20:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2805a8a5-7894-4631-89cd-cab647ef14b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Flow 'volume_create_manager' (4b19fd95-84de-4c82-836f-044fb3d74c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:20 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-7ff92cd8-471a-4933-990e-89a5aef0c381 tempest-VolumesTransfersV355Test-402854834 None] Created volume successfully. Jun 19 04:20:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Acquiring lock "cinder-1b26575f-1f8a-49fc-bd68-fed100f030b6-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Lock "cinder-1b26575f-1f8a-49fc-bd68-fed100f030b6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Acquiring lock "cinder-quobyte-1b26575f-1f8a-49fc-bd68-fed100f030b6" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Lock "cinder-quobyte-1b26575f-1f8a-49fc-bd68-fed100f030b6" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:20 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6343b4-aef1-40c0-91cd-8561edbd1ca0]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b26575f-1f8a-49fc-bd68-fed100f030b6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:20 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b26575f-1f8a-49fc-bd68-fed100f030b6 Jun 19 04:20:20 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:21 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-617de629-b27d-49df-aa90-e8238b909df6 1073741824" returned: 0 in 1.155s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-617de629-b27d-49df-aa90-e8238b909df6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:21 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-617de629-b27d-49df-aa90-e8238b909df6 Jun 19 04:20:21 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:22 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b26575f-1f8a-49fc-bd68-fed100f030b6" returned: 0 in 1.414s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b26575f-1f8a-49fc-bd68-fed100f030b6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:22 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b26575f-1f8a-49fc-bd68-fed100f030b6 Jun 19 04:20:22 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:22 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-617de629-b27d-49df-aa90-e8238b909df6" returned: 0 in 1.342s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] <== create_volume: return (2577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.584s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.859s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-quobyte-ea4453da-fe19-4767-b282-74069604c6f4-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002" by "_create_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306319ca-d8c3-4a89-aaac-a28c0ee353b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-617de629-b27d-49df-aa90-e8238b909df6', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd3203d-7ec1-4d80-844e-99b768be071a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-ea4453da-fe19-4767-b282-74069604c6f4-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002" acquired by "_create_volume_from_snapshot" :: waited 0.079s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Creating volume 0626b2fa-91d8-462b-b4ef-4cf6a6bf0002 from snapshot ea4453da-fe19-4767-b282-74069604c6f4 {{(pid=93530) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-quobyte-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002" by "_copy_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:22 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Volume volume-617de629-b27d-49df-aa90-e8238b909df6 (617de629-b27d-49df-aa90-e8238b909df6): created successfully Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd3203d-7ec1-4d80-844e-99b768be071a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Flow 'volume_create_manager' (ebc54cea-4ba0-4bd7-8cd2-3fd25be34d81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002" acquired by "_copy_volume_from_snapshot" :: waited 0.076s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] snapshot: ea4453da-fe19-4767-b282-74069604c6f4, volume: 0626b2fa-91d8-462b-b4ef-4cf6a6bf0002, {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:22 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-7bb1715e-6203-4abc-a194-0b7245c9a903 tempest-VolumesActionsTest-905428939 None] Created volume successfully. Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[064aa38b-69bb-401e-9c0b-48c77738b0b3]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2162aa3d-017d-489f-a2bf-3e004d8de912 tempest-VolumesActionsTest-905428939 None] Acquiring lock "cinder-617de629-b27d-49df-aa90-e8238b909df6" by "attach_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2162aa3d-017d-489f-a2bf-3e004d8de912 tempest-VolumesActionsTest-905428939 None] Lock "cinder-617de629-b27d-49df-aa90-e8238b909df6" acquired by "attach_volume" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:23 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 Jun 19 04:20:23 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:23 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=84,cinder:INSERT=25,cinder:UPDATE=85,cinder:DELETE=9 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:20:23 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=70,cinder:INSERT=30,cinder:UPDATE=95,cinder:DELETE=9 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:20:23 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-2162aa3d-017d-489f-a2bf-3e004d8de912 tempest-VolumesActionsTest-905428939 None] Attaching volume 617de629-b27d-49df-aa90-e8238b909df6 to instance dc9b3071-261d-432f-b185-5693969b16b5 at mountpoint /dev/vdb on host None. Jun 19 04:20:23 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-2162aa3d-017d-489f-a2bf-3e004d8de912 tempest-VolumesActionsTest-905428939 None] Attach volume completed successfully. Jun 19 04:20:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2162aa3d-017d-489f-a2bf-3e004d8de912 tempest-VolumesActionsTest-905428939 None] Lock "cinder-617de629-b27d-49df-aa90-e8238b909df6" released by "attach_volume" :: held 0.519s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:24 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b26575f-1f8a-49fc-bd68-fed100f030b6" returned: 0 in 1.926s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Lock "cinder-quobyte-1b26575f-1f8a-49fc-bd68-fed100f030b6" released by "delete_volume" :: held 3.405s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Created reservations ['ff6cdd5c-4d8f-4ca4-901f-8a7ad222eaf3', '85e8de0a-e475-46dc-ac56-7cad66fbf173', 'c68ee30a-a531-45be-b288-859550165ee0', '9b58765b-4538-4bbd-bfa2-c7cf52012036'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:24 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:20:24 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:24 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4" returned: 0 in 1.717s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8b78dff-b80b-4387-b5be-0bbcea81c647(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Creating direct copy from snapshot {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb1be94-375d-44f9-8766-1f368a1838a7]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:25 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 Jun 19 04:20:25 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:25 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ea84fcc5-997d-425a-b0ef-ec8302eb4462 tempest-VolumesActionsTest-2077559544 None] Terminate volume connection completed successfully. Jun 19 04:20:25 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.328s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:25 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:25 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Deleted volume successfully. Jun 19 04:20:25 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6a9038ab-aa45-4056-914d-9cb4c7e40138 tempest-VolumesTransfersV355Test-874309031 None] Lock "cinder-1b26575f-1f8a-49fc-bd68-fed100f030b6-delete_volume" released by "delete_volume" :: held 5.116s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:25 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ea84fcc5-997d-425a-b0ef-ec8302eb4462 tempest-VolumesActionsTest-2077559544 None] Acquiring lock "cinder-617de629-b27d-49df-aa90-e8238b909df6-detach_volume" by "detach_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:25 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ea84fcc5-997d-425a-b0ef-ec8302eb4462 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-617de629-b27d-49df-aa90-e8238b909df6-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:25 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ea84fcc5-997d-425a-b0ef-ec8302eb4462 tempest-VolumesActionsTest-2077559544 None] Detaching volume 617de629-b27d-49df-aa90-e8238b909df6 from instance dc9b3071-261d-432f-b185-5693969b16b5. Jun 19 04:20:26 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ea84fcc5-997d-425a-b0ef-ec8302eb4462 tempest-VolumesActionsTest-2077559544 None] Detach volume completed successfully. Jun 19 04:20:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ea84fcc5-997d-425a-b0ef-ec8302eb4462 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-617de629-b27d-49df-aa90-e8238b909df6-detach_volume" released by "detach_volume" :: held 0.240s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:26 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647" returned: 0 in 1.957s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:26 devstack cinder-volume[93530]: DEBUG cinder.utils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Path /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002 not found in is_blk_device check {{(pid=93530) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:20:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:26 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002 Jun 19 04:20:26 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-412962c1-adb3-47f8-938f-a302ff22bef8 tempest-VolumesActionsTest-905428939 None] Acquiring lock "cinder-617de629-b27d-49df-aa90-e8238b909df6-detach_volume" by "detach_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-412962c1-adb3-47f8-938f-a302ff22bef8 tempest-VolumesActionsTest-905428939 None] Lock "cinder-617de629-b27d-49df-aa90-e8238b909df6-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:26 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-412962c1-adb3-47f8-938f-a302ff22bef8 tempest-VolumesActionsTest-905428939 None] Volume detach called, but volume not attached. Jun 19 04:20:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-412962c1-adb3-47f8-938f-a302ff22bef8 tempest-VolumesActionsTest-905428939 None] Lock "cinder-617de629-b27d-49df-aa90-e8238b909df6-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:27 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Acquiring lock "cinder-617de629-b27d-49df-aa90-e8238b909df6-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:27 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Lock "cinder-617de629-b27d-49df-aa90-e8238b909df6-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:27 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Acquiring lock "cinder-quobyte-617de629-b27d-49df-aa90-e8238b909df6" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:27 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Lock "cinder-quobyte-617de629-b27d-49df-aa90-e8238b909df6" acquired by "delete_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:27 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c419ef90-de09-462d-ad85-606e4383da32]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-617de629-b27d-49df-aa90-e8238b909df6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:28 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-617de629-b27d-49df-aa90-e8238b909df6 Jun 19 04:20:28 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:30 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-617de629-b27d-49df-aa90-e8238b909df6" returned: 0 in 2.725s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-617de629-b27d-49df-aa90-e8238b909df6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:30 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-617de629-b27d-49df-aa90-e8238b909df6 Jun 19 04:20:30 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:32 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-617de629-b27d-49df-aa90-e8238b909df6" returned: 0 in 2.148s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:32 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Lock "cinder-quobyte-617de629-b27d-49df-aa90-e8238b909df6" released by "delete_volume" :: held 5.012s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:33 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Created reservations ['11ec7d18-f009-421d-89ef-387a9241e2d5', '89871d2b-0a40-47d7-86de-5a1935e53853', 'bba6ee36-f80a-4e53-bd46-0cde4807c277', '66dff0aa-9d65-4cbc-beed-4751ae252c47'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:33 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:33 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:33 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:20:33 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:35 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 2.317s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:35 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:36 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Deleted volume successfully. Jun 19 04:20:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-17572c97-a122-4e3c-a796-34cf6d80de95 tempest-VolumesActionsTest-905428939 None] Lock "cinder-617de629-b27d-49df-aa90-e8238b909df6-delete_volume" released by "delete_volume" :: held 8.268s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002" returned: 0 in 10.386s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:37 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[541762d7-65c0-4a93-b7a5-2765ac0192c4]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:37 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 Jun 19 04:20:37 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:38 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647" returned: 0 in 1.537s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:38 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Image conversion details: src /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647, size 1024.00 MB, duration 10.39 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:20:38 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Converted 1024.00 MB image at 98.59 MB/s Jun 19 04:20:38 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002 is being set with open permissions: ugo+rw Jun 19 04:20:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:38 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002 Jun 19 04:20:38 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:39 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002" returned: 0 in 0.763s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:39 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002" released by "_copy_volume_from_snapshot" :: held 16.605s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:39 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-ea4453da-fe19-4767-b282-74069604c6f4-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002" released by "_create_volume_from_snapshot" :: held 16.708s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.791s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6163d922-1b5e-4434-b475-3bc96a260154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002', 'volume_size': 1, 'snapshot_id': 'ea4453da-fe19-4767-b282-74069604c6f4'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6344c1-b1cf-4100-8fe5-def7fb78a016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:39 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Volume volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002 (0626b2fa-91d8-462b-b4ef-4cf6a6bf0002): created successfully Jun 19 04:20:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6344c1-b1cf-4100-8fe5-def7fb78a016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Flow 'volume_create_manager' (2f2d3848-f9f1-4cb4-ab35-a74714ee7deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:39 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-403cec46-5e4d-4288-91e1-9cff490dae24 tempest-VolumesDeleteCascade-571225804 None] Created volume successfully. Jun 19 04:20:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-b8b78dff-b80b-4387-b5be-0bbcea81c647-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-b8b78dff-b80b-4387-b5be-0bbcea81c647-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Performing cascade delete. {{(pid=93530) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 19 04:20:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-ea4453da-fe19-4767-b282-74069604c6f4-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-ea4453da-fe19-4767-b282-74069604c6f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-quobyte-b8b78dff-b80b-4387-b5be-0bbcea81c647" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-b8b78dff-b80b-4387-b5be-0bbcea81c647" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-quobyte-ea4453da-fe19-4767-b282-74069604c6f4" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-ea4453da-fe19-4767-b282-74069604c6f4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Deleting offline snapshot ea4453da-fe19-4767-b282-74069604c6f4 of volume b8b78dff-b80b-4387-b5be-0bbcea81c647 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:20:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] snapshot_file for this snap is: volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:20:40 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3a750f-44a6-44b3-b1bb-af1a27a0d797]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:40 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 Jun 19 04:20:40 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:41 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4" returned: 0 in 0.809s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8b78dff-b80b-4387-b5be-0bbcea81c647(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e20971d-a4a8-482b-85d9-6694a1003729]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:41 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 Jun 19 04:20:41 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Flow 'volume_create_manager' (769373f0-8581-4ea9-9b87-7b954853e886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4861dee-f38b-40b2-83ea-fbb451a85cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4861dee-f38b-40b2-83ea-fbb451a85cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-767339313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c9829c-cf7b-472e-82de-0b0307fc6ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15788ea39eb24b4bbee153e5494437c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:41Z,use_quota=True,user_id='96a87b6e6b75482ab68e767fea61f2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa258d7-ac3b-426e-ae67-6fd560352b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa258d7-ac3b-426e-ae67-6fd560352b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa24fb8c-9394-4038-888b-920069dbfd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.image.glance [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Creating Keystone auth plugin from conf {{(pid=93530) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa24fb8c-9394-4038-888b-920069dbfd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31c9829c-cf7b-472e-82de-0b0307fc6ac6', 'volume_name': 'volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6', 'volume_size': 1, 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41c991745fb845ed91d69be55aec3c73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2575cd7a-d982-40e3-b4e5-773946d6aab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2575cd7a-d982-40e3-b4e5-773946d6aab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d075ab-369f-4f22-a47f-253f6e38118f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:41 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Volume 31c9829c-cf7b-472e-82de-0b0307fc6ac6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6', 'volume_size': 1, 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41c991745fb845ed91d69be55aec3c73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Trying to clone 31c9829c-cf7b-472e-82de-0b0307fc6ac6 from image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]). {{(pid=93530) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:20:41 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_1a_gwi8hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:20:41 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Image download 20.69 MB at 20.69 MB/s Jun 19 04:20:42 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647" returned: 0 in 0.824s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:42 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[3869cdee-603a-4d7e-8c88-bbc858320ee0]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_1a_gwi8hdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:42 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 Jun 19 04:20:42 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:42 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_1a_gwi8hdevstack@QuobyteHD Jun 19 04:20:42 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:42 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_1a_gwi8hdevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:42 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Temporary image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 is fetched for user 96a87b6e6b75482ab68e767fea61f2ea. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:20:42 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4" returned: 0 in 0.780s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:42 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4 Jun 19 04:20:42 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:42 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb46fdf-bfb7-4d80-9cd1-afc5be6a40d4]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_1a_gwi8hdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:42 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_1a_gwi8hdevstack@QuobyteHD Jun 19 04:20:42 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:43 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647.ea4453da-fe19-4767-b282-74069604c6f4" returned: 0 in 0.683s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-ea4453da-fe19-4767-b282-74069604c6f4" released by "_delete_snapshot" :: held 3.231s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-b8b78dff-b80b-4387-b5be-0bbcea81c647" released by "delete_snapshot" :: held 3.262s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Created reservations ['918dd03c-d511-4070-b0c0-dcb97a48d8f1', '9d945581-5ed3-4c79-9fe7-cb4fdb3e83fd', 'ba029e20-23b1-4512-a1ea-284571da963d', 'c303a69a-cbae-4fb4-9140-4cdc1cc43b27'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:43 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Delete snapshot completed successfully. Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-ea4453da-fe19-4767-b282-74069604c6f4-delete_snapshot" released by "delete_snapshot" :: held 3.438s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Snapshots deleted, issuing volume delete {{(pid=93530) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-quobyte-b8b78dff-b80b-4387-b5be-0bbcea81c647" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:43 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_1a_gwi8hdevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-767339313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c9829c-cf7b-472e-82de-0b0307fc6ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15788ea39eb24b4bbee153e5494437c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:41Z,use_quota=True,user_id='96a87b6e6b75482ab68e767fea61f2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Creating volume 31c9829c-cf7b-472e-82de-0b0307fc6ac6 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:43 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:43 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 1073741824 Jun 19 04:20:43 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-b8b78dff-b80b-4387-b5be-0bbcea81c647" acquired by "delete_volume" :: waited 0.049s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Flow 'volume_create_manager' (397e1168-d24a-4681-aa04-50fccdc514f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb2947d-f49f-47e3-8af6-2505f4284c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b87aabc-afb6-43d4-991a-9a95bd9a27b3]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb2947d-f49f-47e3-8af6-2505f4284c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2078118357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2111f496-9c64-4e15-8b37-7af67344c5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3f49110e02454ba7b4fa9fdf71685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:44Z,use_quota=True,user_id='3fcfd592f4694c9c9169313990eb4b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e719bbe-b5d3-46ba-8150-df43dafbf8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e719bbe-b5d3-46ba-8150-df43dafbf8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f99a6f-83e8-4d77-bac6-4d77895c35c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f99a6f-83e8-4d77-bac6-4d77895c35c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2111f496-9c64-4e15-8b37-7af67344c5e6', 'volume_name': 'volume-2111f496-9c64-4e15-8b37-7af67344c5e6', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb444f5-3ba7-4c0e-b571-da7f147e2612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb444f5-3ba7-4c0e-b571-da7f147e2612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c836d6-689a-4c4e-89e4-a72be702ce4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:43 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Volume 2111f496-9c64-4e15-8b37-7af67344c5e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2111f496-9c64-4e15-8b37-7af67344c5e6', 'volume_size': 1} Jun 19 04:20:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:43 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 Jun 19 04:20:43 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:44 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647" returned: 0 in 0.772s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:44 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647 Jun 19 04:20:44 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:44 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 1073741824" returned: 0 in 0.940s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:44 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 Jun 19 04:20:44 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:45 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8b78dff-b80b-4387-b5be-0bbcea81c647" returned: 0 in 0.728s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:45 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6" returned: 0 in 0.638s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-b8b78dff-b80b-4387-b5be-0bbcea81c647" released by "delete_volume" :: held 1.590s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.472s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2078118357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2111f496-9c64-4e15-8b37-7af67344c5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3f49110e02454ba7b4fa9fdf71685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:44Z,use_quota=True,user_id='3fcfd592f4694c9c9169313990eb4b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Creating volume 2111f496-9c64-4e15-8b37-7af67344c5e6 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:45 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2111f496-9c64-4e15-8b37-7af67344c5e6 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:45 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2111f496-9c64-4e15-8b37-7af67344c5e6 1073741824 Jun 19 04:20:45 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Attempting download of 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}])) to volume 31c9829c-cf7b-472e-82de-0b0307fc6ac6. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Created reservations ['42315ae1-f6f9-48cd-b9db-96636e23060c', '769459ac-0737-4fc9-80e6-dc036f68d5ee', 'f19a7606-1bde-497b-abd8-4f14d9e667f5', '6789cbd6-5c3e-484d-8ed3-abd963b5f880'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f39a9be-9933-4c37-b584-1e376fe7f50f]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_c8axvotc {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:45 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:20:45 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:45 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_c8axvotc Jun 19 04:20:45 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "cinder-quobyte-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002" acquired by "delete_volume" :: waited 0.031s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:46 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b569385-c45f-4ec0-887c-e842a79b3017]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:46 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002 Jun 19 04:20:46 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:46 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.864s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:46 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:46 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Deleted volume successfully. Jun 19 04:20:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-893b1f7d-ba7c-4c15-a307-515559dfea73 tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-b8b78dff-b80b-4387-b5be-0bbcea81c647-delete_volume" released by "delete_volume" :: held 6.300s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:46 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_c8axvotc" returned: 0 in 1.006s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_c8axvotc {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:46 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2111f496-9c64-4e15-8b37-7af67344c5e6 1073741824" returned: 0 in 1.253s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2111f496-9c64-4e15-8b37-7af67344c5e6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:46 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_c8axvotc Jun 19 04:20:46 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:46 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2111f496-9c64-4e15-8b37-7af67344c5e6 Jun 19 04:20:46 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:47 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002" returned: 0 in 0.987s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:47 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002 Jun 19 04:20:47 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:47 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2111f496-9c64-4e15-8b37-7af67344c5e6" returned: 0 in 0.752s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2c836d6-689a-4c4e-89e4-a72be702ce4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2111f496-9c64-4e15-8b37-7af67344c5e6', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:47 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd797e00-5bc4-4866-8963-5ee0f9efc49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_c8axvotc" returned: 1 in 0.932s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_c8axvotc' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed059e5b-1342-444e-b3a5-8d7383f26c88]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_1a_gwi8hdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:47 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Volume volume-2111f496-9c64-4e15-8b37-7af67344c5e6 (2111f496-9c64-4e15-8b37-7af67344c5e6): created successfully Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd797e00-5bc4-4866-8963-5ee0f9efc49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Flow 'volume_create_manager' (397e1168-d24a-4681-aa04-50fccdc514f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:47 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-860ce836-15a7-40c2-ab0c-98a603965a6f tempest-VolumesActionsTest-905428939 None] Created volume successfully. Jun 19 04:20:47 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_1a_gwi8hdevstack@QuobyteHD Jun 19 04:20:47 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:47 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002" returned: 0 in 0.663s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-quobyte-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002" released by "delete_volume" :: held 1.721s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Created reservations ['1c86d4b6-97e4-4c29-a663-8caea2bf94a8', '414eb2c5-1d03-4b2e-bd1b-4ed0b4fa32d7', '7c768c93-7320-4459-a9a5-7ce1f63f8bb2', '8e4ca933-7b13-4143-998e-f8339e73b474'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:48 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:20:48 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:48 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Acquiring lock "cinder-2111f496-9c64-4e15-8b37-7af67344c5e6-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:48 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-2111f496-9c64-4e15-8b37-7af67344c5e6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:48 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_1a_gwi8hdevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:48 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 was qcow2, converting to raw {{(pid=93530) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:20:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_1a_gwi8hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:48 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_1a_gwi8hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 Jun 19 04:20:48 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:48 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Acquiring lock "cinder-quobyte-2111f496-9c64-4e15-8b37-7af67344c5e6" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:48 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-quobyte-2111f496-9c64-4e15-8b37-7af67344c5e6" acquired by "delete_volume" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:48 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df480c1-9573-4cbd-8295-0a253025ece7]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2111f496-9c64-4e15-8b37-7af67344c5e6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:48 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2111f496-9c64-4e15-8b37-7af67344c5e6 Jun 19 04:20:48 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:48 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.849s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:48 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:48 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Deleted volume successfully. Jun 19 04:20:48 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a02d21ae-a5e9-4933-89b6-cc1c100266ae tempest-VolumesDeleteCascade-571225804 None] Lock "cinder-0626b2fa-91d8-462b-b4ef-4cf6a6bf0002-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Flow 'volume_create_manager' (d7db7e8c-6252-4ebd-a343-54f8936c771f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7a212b-3a12-4101-89ba-f2ed0bc3ad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7a212b-3a12-4101-89ba-f2ed0bc3ad21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-283159547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e904be-04e7-4702-b328-68cc1decdccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6be0a212ae415bbdc43ff339c3db51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:49Z,use_quota=True,user_id='765e938a80a04d7cac57a6a7f15a7040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16efcea5-be4a-47b1-a63a-b16c6012359f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16efcea5-be4a-47b1-a63a-b16c6012359f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395064bb-3b9f-4c8e-991c-f4305834e58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (395064bb-3b9f-4c8e-991c-f4305834e58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91e904be-04e7-4702-b328-68cc1decdccc', 'volume_name': 'volume-91e904be-04e7-4702-b328-68cc1decdccc', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbdc18c-16f6-4597-823e-9d06396130ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcbdc18c-16f6-4597-823e-9d06396130ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841c926b-ad8a-4b73-ab04-d326ec2ce4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:49 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Volume 91e904be-04e7-4702-b328-68cc1decdccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91e904be-04e7-4702-b328-68cc1decdccc', 'volume_size': 1} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-283159547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91e904be-04e7-4702-b328-68cc1decdccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6be0a212ae415bbdc43ff339c3db51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:49Z,use_quota=True,user_id='765e938a80a04d7cac57a6a7f15a7040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Creating volume 91e904be-04e7-4702-b328-68cc1decdccc {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:49 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:49 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc 1073741824 Jun 19 04:20:49 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:49 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2111f496-9c64-4e15-8b37-7af67344c5e6" returned: 0 in 0.993s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2111f496-9c64-4e15-8b37-7af67344c5e6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:49 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2111f496-9c64-4e15-8b37-7af67344c5e6 Jun 19 04:20:49 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:50 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2111f496-9c64-4e15-8b37-7af67344c5e6" returned: 0 in 0.758s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-quobyte-2111f496-9c64-4e15-8b37-7af67344c5e6" released by "delete_volume" :: held 1.815s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:50 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Created reservations ['c0c2d784-fa3f-4e0f-b840-ecc59d48af1a', '383c52e7-e9ff-46f2-b219-bfe09b824eae', '3d145fa5-2e6f-4313-83f3-b5fbbe0ec976', 'e0b28b0b-186a-43d0-9d02-8410a9528c72'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:50 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:20:50 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:50 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc 1073741824" returned: 0 in 1.386s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:50 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc Jun 19 04:20:50 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:51 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:51 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_1a_gwi8hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6" returned: 0 in 2.954s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_1a_gwi8hdevstack@QuobyteHD, size 112.00 MB, duration 2.96 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:20:51 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Converted 112.00 MB image at 37.89 MB/s Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.876s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:51 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Deleted volume successfully. Jun 19 04:20:51 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 1G Jun 19 04:20:51 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94652c99-e628-4164-b052-383f92e263a0 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-2111f496-9c64-4e15-8b37-7af67344c5e6-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Flow 'volume_create_manager' (3d6e9159-c62f-4710-9f93-dca9801c2fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1510581-27b3-49aa-a4f0-60a442d67dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1510581-27b3-49aa-a4f0-60a442d67dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-264590339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375e32b7-709d-44ab-b3a7-5d7144a9d26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3f49110e02454ba7b4fa9fdf71685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:51Z,use_quota=True,user_id='3fcfd592f4694c9c9169313990eb4b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb49d2d-0806-4d38-a34c-684227b978ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bb49d2d-0806-4d38-a34c-684227b978ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5fd234-45f5-4fc3-87b0-835beac7faf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb5fd234-45f5-4fc3-87b0-835beac7faf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '375e32b7-709d-44ab-b3a7-5d7144a9d26e', 'volume_name': 'volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb23e380-c37a-4832-b945-9a10c4b3b442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb23e380-c37a-4832-b945-9a10c4b3b442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1d96f8-189b-4863-9286-bc8de31e952e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:51 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Volume 375e32b7-709d-44ab-b3a7-5d7144a9d26e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e', 'volume_size': 1} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:51 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc" returned: 0 in 0.979s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] <== create_volume: return (2431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.434s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.216s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-264590339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375e32b7-709d-44ab-b3a7-5d7144a9d26e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3f49110e02454ba7b4fa9fdf71685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:51Z,use_quota=True,user_id='3fcfd592f4694c9c9169313990eb4b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Creating volume 375e32b7-709d-44ab-b3a7-5d7144a9d26e {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:51 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841c926b-ad8a-4b73-ab04-d326ec2ce4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91e904be-04e7-4702-b328-68cc1decdccc', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:51 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e 1073741824 Jun 19 04:20:51 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28377867-b651-43e3-b4d9-bba9161f8a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:51 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Volume volume-91e904be-04e7-4702-b328-68cc1decdccc (91e904be-04e7-4702-b328-68cc1decdccc): created successfully Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28377867-b651-43e3-b4d9-bba9161f8a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Flow 'volume_create_manager' (d7db7e8c-6252-4ebd-a343-54f8936c771f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:51 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-0eba817d-b6ae-4af2-90d9-0836661dfa70 tempest-AttachVolumeTestJSON-665193495 None] Created volume successfully. Jun 19 04:20:51 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 1G" returned: 0 in 0.814s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfc16e3-911b-4b36-8c74-880e33def442]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:52 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 Jun 19 04:20:52 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:52 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Flow 'volume_create_manager' (259d39b9-0bf7-4c52-8948-3023b3e53464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e345ce-1dda-4e25-a662-39b7d7650a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e 1073741824" returned: 0 in 1.085s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94e345ce-1dda-4e25-a662-39b7d7650a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1481645360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d07dff-0188-4510-851b-e3c2b1cab0f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ad4f8242b74dd78cea71a3f5a7d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:53Z,use_quota=True,user_id='5252e4e29cfe4c679c3675d4ab5dc26e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d128559-a9da-4e2e-8c2d-b21924003721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d128559-a9da-4e2e-8c2d-b21924003721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74be62c-9071-4d75-ba58-8ec247bcc385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e74be62c-9071-4d75-ba58-8ec247bcc385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d07dff-0188-4510-851b-e3c2b1cab0f9', 'volume_name': 'volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d38251-0a2a-455f-ba75-fcf915107088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d38251-0a2a-455f-ba75-fcf915107088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e589e7c-04cb-4d35-985e-fd03fbb81707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:52 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Volume a2d07dff-0188-4510-851b-e3c2b1cab0f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9', 'volume_size': 1} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:52 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e Jun 19 04:20:52 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:52 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6" returned: 0 in 0.932s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:53 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 Jun 19 04:20:53 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:53 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e" returned: 0 in 0.682s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1481645360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d07dff-0188-4510-851b-e3c2b1cab0f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ad4f8242b74dd78cea71a3f5a7d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:53Z,use_quota=True,user_id='5252e4e29cfe4c679c3675d4ab5dc26e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Creating volume a2d07dff-0188-4510-851b-e3c2b1cab0f9 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:53 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e1d96f8-189b-4863-9286-bc8de31e952e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:53 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9 1073741824 Jun 19 04:20:53 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c323eaa8-7aae-4637-b923-d8b003cf9b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:53 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Volume volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e (375e32b7-709d-44ab-b3a7-5d7144a9d26e): created successfully Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c323eaa8-7aae-4637-b923-d8b003cf9b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Flow 'volume_create_manager' (3d6e9159-c62f-4710-9f93-dca9801c2fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:53 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-376c7476-f105-42ec-aa30-abbc295cfd69 tempest-VolumesActionsTest-905428939 None] Created volume successfully. Jun 19 04:20:53 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6" returned: 1 in 0.794s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Downloaded image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}])) to volume 31c9829c-cf7b-472e-82de-0b0307fc6ac6 successfully. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Temporary image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 for user 96a87b6e6b75482ab68e767fea61f2ea is deleted. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Marking volume 31c9829c-cf7b-472e-82de-0b0307fc6ac6 as bootable. {{(pid=93530) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Copying metadata from image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 to 31c9829c-cf7b-472e-82de-0b0307fc6ac6. {{(pid=93530) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Creating volume glance metadata for volume 31c9829c-cf7b-472e-82de-0b0307fc6ac6 backed by image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93530) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d075ab-369f-4f22-a47f-253f6e38118f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6', 'volume_size': 1, 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41c991745fb845ed91d69be55aec3c73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0488dea6-92a8-42f0-8dcc-f115040a6146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:53 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Volume volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 (31c9829c-cf7b-472e-82de-0b0307fc6ac6): created successfully Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0488dea6-92a8-42f0-8dcc-f115040a6146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Flow 'volume_create_manager' (769373f0-8581-4ea9-9b87-7b954853e886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:53 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-678980c4-148e-447f-ac34-551aa9fa2abf tempest-VolumesExtendTest-78090147 None] Created volume successfully. Jun 19 04:20:54 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9 1073741824" returned: 0 in 0.860s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:54 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9 Jun 19 04:20:54 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Acquiring lock "cinder-375e32b7-709d-44ab-b3a7-5d7144a9d26e-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-375e32b7-709d-44ab-b3a7-5d7144a9d26e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-827778cb-7b2b-4900-83ce-1289eecb8f40 tempest-VolumesExtendTest-78090147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Acquiring lock "cinder-quobyte-375e32b7-709d-44ab-b3a7-5d7144a9d26e" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-quobyte-375e32b7-709d-44ab-b3a7-5d7144a9d26e" acquired by "delete_volume" :: waited 0.031s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:54 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ce0c35-6b09-4331-8b42-384c126ed6a8]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:54 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e Jun 19 04:20:54 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:55 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9" returned: 0 in 0.850s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-827778cb-7b2b-4900-83ce-1289eecb8f40 tempest-VolumesExtendTest-78090147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.669s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e589e7c-04cb-4d35-985e-fd03fbb81707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f88469-14ca-4477-808f-068a50add4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:55 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0533bc-aa83-4249-84fc-977df7dc308d]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-827778cb-7b2b-4900-83ce-1289eecb8f40 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:55 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Volume volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9 (a2d07dff-0188-4510-851b-e3c2b1cab0f9): created successfully Jun 19 04:20:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f88469-14ca-4477-808f-068a50add4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Flow 'volume_create_manager' (259d39b9-0bf7-4c52-8948-3023b3e53464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:55 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-423f60a8-54a8-4782-af22-9ab19c531945 tempest-VolumesMetadataTest-1880028256 None] Created volume successfully. Jun 19 04:20:55 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 Jun 19 04:20:55 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:55 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e" returned: 0 in 0.891s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:55 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e Jun 19 04:20:55 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-300709cc-7c69-479c-b595-8d5d764083f9 req-63132448-18b3-4468-8b7a-9eea8567d43f tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:56 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-827778cb-7b2b-4900-83ce-1289eecb8f40 tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6" returned: 0 in 0.889s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-827778cb-7b2b-4900-83ce-1289eecb8f40 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:56 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 Jun 19 04:20:56 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:56 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-375e32b7-709d-44ab-b3a7-5d7144a9d26e" returned: 0 in 0.732s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-quobyte-375e32b7-709d-44ab-b3a7-5d7144a9d26e" released by "delete_volume" :: held 1.681s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Created reservations ['7d3ead50-18ea-4544-b9ed-e0b697c07334', 'd5757522-0b24-47af-926a-f2dbd3d4d867', 'd4b8b432-0130-45d8-a67b-068505253955', '61ec6324-d36a-4747-ac52-b6250bbb522b'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:56 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:20:56 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Acquiring lock "cinder-a2d07dff-0188-4510-851b-e3c2b1cab0f9-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Lock "cinder-a2d07dff-0188-4510-851b-e3c2b1cab0f9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Acquiring lock "cinder-quobyte-a2d07dff-0188-4510-851b-e3c2b1cab0f9" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Lock "cinder-quobyte-a2d07dff-0188-4510-851b-e3c2b1cab0f9" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee86bcf5-cc80-4bcf-ab74-e9f51d51315f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:56 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9 Jun 19 04:20:56 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:57 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-827778cb-7b2b-4900-83ce-1289eecb8f40 tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6" returned: 1 in 0.894s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-827778cb-7b2b-4900-83ce-1289eecb8f40 tempest-VolumesExtendTest-78090147 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-827778cb-7b2b-4900-83ce-1289eecb8f40 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 2G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-827778cb-7b2b-4900-83ce-1289eecb8f40 tempest-VolumesExtendTest-78090147 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 2G" returned: 0 in 0.088s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-827778cb-7b2b-4900-83ce-1289eecb8f40 tempest-VolumesExtendTest-78090147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.920s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-300709cc-7c69-479c-b595-8d5d764083f9 req-63132448-18b3-4468-8b7a-9eea8567d43f tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.399s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99a4735-bbe5-4425-8e63-510a711e9cfa]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-300709cc-7c69-479c-b595-8d5d764083f9 req-63132448-18b3-4468-8b7a-9eea8567d43f tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:57 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-827778cb-7b2b-4900-83ce-1289eecb8f40 tempest-VolumesExtendTest-78090147 None] Extend volume completed successfully. Jun 19 04:20:57 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.793s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:57 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Deleted volume successfully. Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-23f80f42-ef88-497c-8a99-4c35433bfe02 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-375e32b7-709d-44ab-b3a7-5d7144a9d26e-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:57 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc Jun 19 04:20:57 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Flow 'volume_create_manager' (dd143c49-b381-49f1-a732-9187443170a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5c2cb3-9f02-457f-9710-e9c060ded61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5c2cb3-9f02-457f-9710-e9c060ded61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1134026592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75f8e81-7412-47e1-bc85-d3bc8f3c6b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3f49110e02454ba7b4fa9fdf71685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:58Z,use_quota=True,user_id='3fcfd592f4694c9c9169313990eb4b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb134823-d787-429c-9f0a-fe9d2759aa15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb134823-d787-429c-9f0a-fe9d2759aa15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4baeb6-0d17-40ee-844c-6535ee4d2785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4baeb6-0d17-40ee-844c-6535ee4d2785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75f8e81-7412-47e1-bc85-d3bc8f3c6b93', 'volume_name': 'volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cb5325-18eb-4056-a540-4482e30cbd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cb5325-18eb-4056-a540-4482e30cbd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650ee7cd-8683-45fe-965d-20216b279c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:57 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Volume b75f8e81-7412-47e1-bc85-d3bc8f3c6b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93', 'volume_size': 1} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:57 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9" returned: 0 in 0.895s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:57 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9 Jun 19 04:20:57 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:58 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-300709cc-7c69-479c-b595-8d5d764083f9 req-63132448-18b3-4468-8b7a-9eea8567d43f tempest-AttachVolumeTestJSON-665193495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc" returned: 0 in 0.862s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-300709cc-7c69-479c-b595-8d5d764083f9 req-63132448-18b3-4468-8b7a-9eea8567d43f tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.885s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.345s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1134026592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75f8e81-7412-47e1-bc85-d3bc8f3c6b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3f49110e02454ba7b4fa9fdf71685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:58Z,use_quota=True,user_id='3fcfd592f4694c9c9169313990eb4b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Creating volume b75f8e81-7412-47e1-bc85-d3bc8f3c6b93 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:58 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:58 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93 1073741824 Jun 19 04:20:58 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-300709cc-7c69-479c-b595-8d5d764083f9 req-63132448-18b3-4468-8b7a-9eea8567d43f tempest-AttachVolumeTestJSON-665193495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-91e904be-04e7-4702-b328-68cc1decdccc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd651d4cb-08c8-4b1f-abb0-41b7a393e8c5', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:20:58 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-300709cc-7c69-479c-b595-8d5d764083f9 req-63132448-18b3-4468-8b7a-9eea8567d43f tempest-AttachVolumeTestJSON-665193495 None] attachment_update completed successfully. Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Acquiring lock "cinder-31c9829c-cf7b-472e-82de-0b0307fc6ac6-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Lock "cinder-31c9829c-cf7b-472e-82de-0b0307fc6ac6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Acquiring lock "cinder-quobyte-31c9829c-cf7b-472e-82de-0b0307fc6ac6" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Lock "cinder-quobyte-31c9829c-cf7b-472e-82de-0b0307fc6ac6" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab317954-e9ba-4c63-bd10-a2d2fda4e714]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:58 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 Jun 19 04:20:58 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:58 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a2d07dff-0188-4510-851b-e3c2b1cab0f9" returned: 0 in 0.845s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Lock "cinder-quobyte-a2d07dff-0188-4510-851b-e3c2b1cab0f9" released by "delete_volume" :: held 1.796s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Created reservations ['d0fb87e5-d8e6-4f6e-862e-8663b84e3f65', 'e2414c1f-d90b-45d5-b1b6-e43193a9b5fd', 'f6152aa7-2574-4f44-bea1-937e605351a3', '30858ba5-99bc-46da-90b7-26b42c4e2d88'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:58 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:20:58 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:58 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:20:58 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:59 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93 1073741824" returned: 0 in 1.067s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:59 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93 Jun 19 04:20:59 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:59 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6" returned: 0 in 0.964s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:59 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 Jun 19 04:20:59 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:59 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.036s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:59 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Deleted volume successfully. Jun 19 04:20:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b6396a46-7d97-4627-b043-ae9c64ed7f92 tempest-VolumesMetadataTest-1880028256 None] Lock "cinder-a2d07dff-0188-4510-851b-e3c2b1cab0f9-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:59 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.011s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:20:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:20:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:21:00 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93" returned: 0 in 1.095s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] <== create_volume: return (2229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.233s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650ee7cd-8683-45fe-965d-20216b279c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b818defc-b0ee-46de-ba4d-6b69f1fbc4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:00 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Volume volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93 (b75f8e81-7412-47e1-bc85-d3bc8f3c6b93): created successfully Jun 19 04:21:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b818defc-b0ee-46de-ba4d-6b69f1fbc4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Flow 'volume_create_manager' (dd143c49-b381-49f1-a732-9187443170a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:00 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d875a340-e2c2-45ac-b0ef-60866031eae0 tempest-VolumesActionsTest-905428939 None] Created volume successfully. Jun 19 04:21:00 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6" returned: 1 in 1.095s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:21:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:00 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6 Jun 19 04:21:00 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Acquiring lock "cinder-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:01 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-31c9829c-cf7b-472e-82de-0b0307fc6ac6" returned: 0 in 0.724s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Lock "cinder-quobyte-31c9829c-cf7b-472e-82de-0b0307fc6ac6" released by "delete_volume" :: held 2.886s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Acquiring lock "cinder-quobyte-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-quobyte-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5a7acd-b1c1-462d-800b-7e7f5b545b68]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Created reservations ['b1d5bcfb-1fdb-422f-bbaf-55043a906ea6', '5ff3f045-4002-4bae-a3b6-2f038ea676be', '0647d663-e0f7-492b-acb3-41ec0fc53ea3', 'f3913870-6151-474d-8833-e3f53c3f9175'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:01 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93 Jun 19 04:21:01 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:01 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:01 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Flow 'volume_create_manager' (0742e476-a14a-44cc-a487-dfb8e790490f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97aa95d3-90a8-43bd-8be0-3d0691f207f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97aa95d3-90a8-43bd-8be0-3d0691f207f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1036665579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af101639-b0e1-43ea-a7e6-eab552315124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15788ea39eb24b4bbee153e5494437c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:02Z,use_quota=True,user_id='96a87b6e6b75482ab68e767fea61f2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677cdae5-01fa-4489-9fd4-956b51cfa339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:02 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677cdae5-01fa-4489-9fd4-956b51cfa339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69d35e9-9330-4c86-8472-2d414ae50cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69d35e9-9330-4c86-8472-2d414ae50cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af101639-b0e1-43ea-a7e6-eab552315124', 'volume_name': 'volume-af101639-b0e1-43ea-a7e6-eab552315124', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541b73bf-18e1-46e7-8798-28239d89ee61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541b73bf-18e1-46e7-8798-28239d89ee61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649ff2d4-5411-41b1-861f-ce18a58c26f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:02 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Volume af101639-b0e1-43ea-a7e6-eab552315124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af101639-b0e1-43ea-a7e6-eab552315124', 'volume_size': 1} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1036665579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af101639-b0e1-43ea-a7e6-eab552315124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15788ea39eb24b4bbee153e5494437c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:02Z,use_quota=True,user_id='96a87b6e6b75482ab68e767fea61f2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Creating volume af101639-b0e1-43ea-a7e6-eab552315124 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:02 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.917s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:02 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Deleted volume successfully. Jun 19 04:21:02 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 1073741824 Jun 19 04:21:02 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0e3063b8-5c12-4958-94ae-ae29c3867e42 tempest-VolumesExtendTest-78090147 None] Lock "cinder-31c9829c-cf7b-472e-82de-0b0307fc6ac6-delete_volume" released by "delete_volume" :: held 4.128s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:02 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93" returned: 0 in 1.116s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:02 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93 Jun 19 04:21:02 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Flow 'volume_create_manager' (6549d04c-6d86-4e6e-8c50-c57d0e731903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00172865-c4a8-4d37-9253-74df65094bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00172865-c4a8-4d37-9253-74df65094bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-339364717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc46e831-6f02-4626-9227-30d033333f5a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f519020c3675468f8a5bf34063561fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:03Z,use_quota=True,user_id='52ec8a9b33e849659eec2b9893fb8db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33caa61-5960-49b3-be72-66f7dec0485b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33caa61-5960-49b3-be72-66f7dec0485b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e199f72-e045-440c-9b23-b15657b16ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e199f72-e045-440c-9b23-b15657b16ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc46e831-6f02-4626-9227-30d033333f5a', 'volume_name': 'volume-dc46e831-6f02-4626-9227-30d033333f5a', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5280ef-87fd-46bf-803d-494002809c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5280ef-87fd-46bf-803d-494002809c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca732e6-08cc-4670-91de-7772e6a044d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:02 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Volume dc46e831-6f02-4626-9227-30d033333f5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc46e831-6f02-4626-9227-30d033333f5a', 'volume_size': 1} Jun 19 04:21:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:03 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93" returned: 0 in 0.681s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-quobyte-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93" released by "delete_volume" :: held 1.860s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:03 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Created reservations ['be3eb78c-d50e-4f47-b506-6ebf3899406c', '5c4f762c-f8af-47ba-94cf-12be460b9265', '4a5a6f91-f905-4e72-b08e-e629f8617f76', 'ad8b8f42-b830-4915-9fb3-50f6ca52cce1'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:03 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:03 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:03 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 1073741824" returned: 0 in 1.116s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:03 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 Jun 19 04:21:03 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:04 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.783s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:04 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Deleted volume successfully. Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1400f09a-42ad-4d23-bab8-69ea4841da85 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-b75f8e81-7412-47e1-bc85-d3bc8f3c6b93-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Flow 'volume_create_manager' (f8e9f6f6-2870-4e33-a548-aeb7d3eabec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61f515c-2ce8-4b5a-b78e-2ba78eb960b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e61f515c-2ce8-4b5a-b78e-2ba78eb960b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-782662011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36efc2a9-9244-4d21-8034-9e7f208ed487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3f49110e02454ba7b4fa9fdf71685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:04Z,use_quota=True,user_id='3fcfd592f4694c9c9169313990eb4b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d69bd7-626a-43fa-a8f9-ac9ad6c4b558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d69bd7-626a-43fa-a8f9-ac9ad6c4b558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff74acfe-524b-4e24-8915-77248c3a0a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff74acfe-524b-4e24-8915-77248c3a0a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36efc2a9-9244-4d21-8034-9e7f208ed487', 'volume_name': 'volume-36efc2a9-9244-4d21-8034-9e7f208ed487', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c263ea90-414f-435e-8c6d-b6e580e6af7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c263ea90-414f-435e-8c6d-b6e580e6af7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04991e70-f5e0-4f6c-bf0e-a80d1616bff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:04 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Volume 36efc2a9-9244-4d21-8034-9e7f208ed487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36efc2a9-9244-4d21-8034-9e7f208ed487', 'volume_size': 1} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:04 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124" returned: 0 in 0.827s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Flow 'volume_create_manager' (088db728-5931-4ee0-b478-ba288198638c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebe37de-89b7-4bdc-8bb3-b3a88167dfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.431s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-339364717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc46e831-6f02-4626-9227-30d033333f5a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f519020c3675468f8a5bf34063561fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:03Z,use_quota=True,user_id='52ec8a9b33e849659eec2b9893fb8db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Creating volume dc46e831-6f02-4626-9227-30d033333f5a {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:04 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dc46e831-6f02-4626-9227-30d033333f5a 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ebe37de-89b7-4bdc-8bb3-b3a88167dfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1901718721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a426a355-7c3b-4986-a9c1-2126c83a4570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6be0a212ae415bbdc43ff339c3db51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:04Z,use_quota=True,user_id='765e938a80a04d7cac57a6a7f15a7040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:04 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dc46e831-6f02-4626-9227-30d033333f5a 1073741824 Jun 19 04:21:04 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db811c8-caf4-430f-aee6-b147036a8dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db811c8-caf4-430f-aee6-b147036a8dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ecb56e0-3583-4968-94d9-0fe2293f638f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ecb56e0-3583-4968-94d9-0fe2293f638f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a426a355-7c3b-4986-a9c1-2126c83a4570', 'volume_name': 'volume-a426a355-7c3b-4986-a9c1-2126c83a4570', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0ff83f-a6ea-4e97-b1f1-94bdd9a8b363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0ff83f-a6ea-4e97-b1f1-94bdd9a8b363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088910b8-3aa7-4a4e-be76-17592d6ffcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:04 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Volume a426a355-7c3b-4986-a9c1-2126c83a4570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a426a355-7c3b-4986-a9c1-2126c83a4570', 'volume_size': 1} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649ff2d4-5411-41b1-861f-ce18a58c26f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af101639-b0e1-43ea-a7e6-eab552315124', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee1dbe9-3420-42f5-ae7e-bc23142c22a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:04 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Volume volume-af101639-b0e1-43ea-a7e6-eab552315124 (af101639-b0e1-43ea-a7e6-eab552315124): created successfully Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee1dbe9-3420-42f5-ae7e-bc23142c22a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Flow 'volume_create_manager' (0742e476-a14a-44cc-a487-dfb8e790490f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:04 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-b2529762-3617-42b9-9ccb-16ec7f54d8b0 tempest-VolumesExtendTest-78090147 None] Created volume successfully. Jun 19 04:21:05 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dc46e831-6f02-4626-9227-30d033333f5a 1073741824" returned: 0 in 0.863s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dc46e831-6f02-4626-9227-30d033333f5a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:05 devstack sudo[102857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dc46e831-6f02-4626-9227-30d033333f5a Jun 19 04:21:05 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:05 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dc46e831-6f02-4626-9227-30d033333f5a" returned: 0 in 0.641s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.650s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-782662011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36efc2a9-9244-4d21-8034-9e7f208ed487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3f49110e02454ba7b4fa9fdf71685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:04Z,use_quota=True,user_id='3fcfd592f4694c9c9169313990eb4b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Creating volume 36efc2a9-9244-4d21-8034-9e7f208ed487 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:05 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-36efc2a9-9244-4d21-8034-9e7f208ed487 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca732e6-08cc-4670-91de-7772e6a044d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc46e831-6f02-4626-9227-30d033333f5a', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:05 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-36efc2a9-9244-4d21-8034-9e7f208ed487 1073741824 Jun 19 04:21:05 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b948c34d-f7fe-4b3f-8e50-d3fd06d283b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:05 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Volume volume-dc46e831-6f02-4626-9227-30d033333f5a (dc46e831-6f02-4626-9227-30d033333f5a): created successfully Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b948c34d-f7fe-4b3f-8e50-d3fd06d283b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Flow 'volume_create_manager' (6549d04c-6d86-4e6e-8c50-c57d0e731903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:05 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-be746dfb-1db6-41cc-8622-ec3127c9c462 tempest-VolumesGetTest-1052626978 None] Created volume successfully. Jun 19 04:21:06 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-36efc2a9-9244-4d21-8034-9e7f208ed487 1073741824" returned: 0 in 0.900s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:06 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Flow 'volume_create_manager' (f553330d-0cae-481b-b9ec-7b615fa7e5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960127d6-0bc8-47f7-a1aa-a19f1bdf4ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (960127d6-0bc8-47f7-a1aa-a19f1bdf4ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-765112962',display_name='tempest-VolumesGetTest-Volume-157441763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6c51a2-b17d-4a7d-861a-5ca966723912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f519020c3675468f8a5bf34063561fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:07Z,use_quota=True,user_id='52ec8a9b33e849659eec2b9893fb8db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5cafe97-9c54-4971-9184-ff7f2f47cf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5cafe97-9c54-4971-9184-ff7f2f47cf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62c5f4e-bf27-4a99-8b0b-85178d58bb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62c5f4e-bf27-4a99-8b0b-85178d58bb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c6c51a2-b17d-4a7d-861a-5ca966723912', 'volume_name': 'volume-7c6c51a2-b17d-4a7d-861a-5ca966723912', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb17bc5b-ec9c-44ca-ada4-83cf7aebc8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb17bc5b-ec9c-44ca-ada4-83cf7aebc8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543b4c0f-95e0-45a4-9c13-88f3bb77d8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:06 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Volume 7c6c51a2-b17d-4a7d-861a-5ca966723912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c6c51a2-b17d-4a7d-861a-5ca966723912', 'volume_size': 1} Jun 19 04:21:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-36efc2a9-9244-4d21-8034-9e7f208ed487 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:06 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-36efc2a9-9244-4d21-8034-9e7f208ed487 Jun 19 04:21:06 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:07 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-36efc2a9-9244-4d21-8034-9e7f208ed487" returned: 0 in 0.648s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.148s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1901718721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a426a355-7c3b-4986-a9c1-2126c83a4570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6be0a212ae415bbdc43ff339c3db51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:04Z,use_quota=True,user_id='765e938a80a04d7cac57a6a7f15a7040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Creating volume a426a355-7c3b-4986-a9c1-2126c83a4570 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:07 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:07 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570 1073741824 Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04991e70-f5e0-4f6c-bf0e-a80d1616bff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36efc2a9-9244-4d21-8034-9e7f208ed487', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:07 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d893b76-47fd-4591-bd1c-8f9ea19a1b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:07 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Volume volume-36efc2a9-9244-4d21-8034-9e7f208ed487 (36efc2a9-9244-4d21-8034-9e7f208ed487): created successfully Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d893b76-47fd-4591-bd1c-8f9ea19a1b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Flow 'volume_create_manager' (f8e9f6f6-2870-4e33-a548-aeb7d3eabec6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:07 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-14a07510-136b-4a89-bcca-3ba10282c627 tempest-VolumesActionsTest-905428939 None] Created volume successfully. Jun 19 04:21:08 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570 1073741824" returned: 0 in 0.831s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Acquiring lock "cinder-36efc2a9-9244-4d21-8034-9e7f208ed487-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:08 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570 Jun 19 04:21:08 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-36efc2a9-9244-4d21-8034-9e7f208ed487-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Acquiring lock "cinder-quobyte-36efc2a9-9244-4d21-8034-9e7f208ed487" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-quobyte-36efc2a9-9244-4d21-8034-9e7f208ed487" acquired by "delete_volume" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:08 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dfd170-b5c7-4901-a9b5-76161761356a]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-36efc2a9-9244-4d21-8034-9e7f208ed487 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:08 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-36efc2a9-9244-4d21-8034-9e7f208ed487 Jun 19 04:21:08 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:09 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570" returned: 0 in 0.749s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.746s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] Creating offline snapshot d5c1053b-af1a-4ad1-a646-ad69dd1992d4 of volume af101639-b0e1-43ea-a7e6-eab552315124 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (088910b8-3aa7-4a4e-be76-17592d6ffcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a426a355-7c3b-4986-a9c1-2126c83a4570', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e842834-6251-429c-a88b-c72ba9ecd738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[94169a6e-c252-4175-9eb9-2bbfa978e6ee]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:09 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Volume volume-a426a355-7c3b-4986-a9c1-2126c83a4570 (a426a355-7c3b-4986-a9c1-2126c83a4570): created successfully Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e842834-6251-429c-a88b-c72ba9ecd738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Flow 'volume_create_manager' (088db728-5931-4ee0-b478-ba288198638c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:09 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-451a239b-2f64-4daf-9905-02729077e778 tempest-AttachVolumeTestJSON-665193495 None] Created volume successfully. Jun 19 04:21:09 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-36efc2a9-9244-4d21-8034-9e7f208ed487" returned: 0 in 0.781s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-36efc2a9-9244-4d21-8034-9e7f208ed487 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:09 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-36efc2a9-9244-4d21-8034-9e7f208ed487 Jun 19 04:21:09 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:09 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 Jun 19 04:21:09 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:09 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-36efc2a9-9244-4d21-8034-9e7f208ed487" returned: 0 in 0.653s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:09 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-quobyte-36efc2a9-9244-4d21-8034-9e7f208ed487" released by "delete_volume" :: held 1.494s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:10 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:10 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Created reservations ['1503107a-f62d-42ba-ad4a-51db3538e225', '2ff6897f-abeb-41b0-a192-ec0069aa4190', 'b2cd25be-7c97-415f-a0c0-755ba2c5d611', 'ef216a34-28c3-43a8-9dac-293aa06d796c'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124" returned: 0 in 0.840s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:10 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 1G Jun 19 04:21:10 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:10 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:10 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:10 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.674s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:10 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:10 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Deleted volume successfully. Jun 19 04:21:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6f113730-7955-4f84-bfbe-9d6ef567a138 tempest-VolumesActionsTest-2077559544 None] Lock "cinder-36efc2a9-9244-4d21-8034-9e7f208ed487-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:10 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 1G" returned: 0 in 0.923s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af101639-b0e1-43ea-a7e6-eab552315124 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:10 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af101639-b0e1-43ea-a7e6-eab552315124 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 Jun 19 04:21:10 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:11 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Flow 'volume_create_manager' (d734c6e8-8495-43a2-990a-3f8ee71cd0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e86f726-e030-44bc-b92b-494242ae5364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e86f726-e030-44bc-b92b-494242ae5364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1528881895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e07086-a23d-4686-a804-a3a84e4dd238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3f49110e02454ba7b4fa9fdf71685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:11Z,use_quota=True,user_id='3fcfd592f4694c9c9169313990eb4b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d7d35b-84b2-47b4-839f-f67ea6726cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d7d35b-84b2-47b4-839f-f67ea6726cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c56afd7-da7e-49e6-bb74-617a72716891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c56afd7-da7e-49e6-bb74-617a72716891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25e07086-a23d-4686-a804-a3a84e4dd238', 'volume_name': 'volume-25e07086-a23d-4686-a804-a3a84e4dd238', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656b87ee-d4ac-41ff-8296-aaf80e6c82ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656b87ee-d4ac-41ff-8296-aaf80e6c82ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313d3915-e3a9-400a-aff6-62322aa4721a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:11 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Volume 25e07086-a23d-4686-a804-a3a84e4dd238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25e07086-a23d-4686-a804-a3a84e4dd238', 'volume_size': 1} Jun 19 04:21:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:11 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af101639-b0e1-43ea-a7e6-eab552315124 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4" returned: 0 in 0.751s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:11 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 is being set with open permissions: ugo+rw Jun 19 04:21:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:11 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 Jun 19 04:21:11 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:12 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4" returned: 0 in 0.640s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:12 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.info Jun 19 04:21:12 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:13 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.info" returned: 0 in 0.735s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:13 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.info is being set with open permissions: ugo+rw Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:13 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.info Jun 19 04:21:13 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-68539899-218a-4948-a0a1-1309b35e6a7e req-a095c226-97cb-4ba2-9dde-89934fc8b46b tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:13 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.info" returned: 0 in 0.693s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.675s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.974s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-765112962',display_name='tempest-VolumesGetTest-Volume-157441763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c6c51a2-b17d-4a7d-861a-5ca966723912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f519020c3675468f8a5bf34063561fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:07Z,use_quota=True,user_id='52ec8a9b33e849659eec2b9893fb8db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Creating volume 7c6c51a2-b17d-4a7d-861a-5ca966723912 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:13 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:21:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c6c51a2-b17d-4a7d-861a-5ca966723912 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:13 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c6c51a2-b17d-4a7d-861a-5ca966723912 1073741824 Jun 19 04:21:13 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:13 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-04cc2b7e-c3b2-4389-b785-8f30ea03ad29 tempest-VolumesExtendTest-78090147 None] Create snapshot completed successfully Jun 19 04:21:14 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c6c51a2-b17d-4a7d-861a-5ca966723912 1073741824" returned: 0 in 0.877s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c6c51a2-b17d-4a7d-861a-5ca966723912 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:14 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c6c51a2-b17d-4a7d-861a-5ca966723912 Jun 19 04:21:14 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2f7bd904-9cbd-4cf5-a2da-d61f9846a3a5 tempest-VolumesExtendTest-78090147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:15 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c6c51a2-b17d-4a7d-861a-5ca966723912" returned: 0 in 0.627s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.077s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1528881895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25e07086-a23d-4686-a804-a3a84e4dd238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a3f49110e02454ba7b4fa9fdf71685a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:11Z,use_quota=True,user_id='3fcfd592f4694c9c9169313990eb4b33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Creating volume 25e07086-a23d-4686-a804-a3a84e4dd238 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:15 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-25e07086-a23d-4686-a804-a3a84e4dd238 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (543b4c0f-95e0-45a4-9c13-88f3bb77d8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c6c51a2-b17d-4a7d-861a-5ca966723912', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:15 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-25e07086-a23d-4686-a804-a3a84e4dd238 1073741824 Jun 19 04:21:15 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b06a3e2-ae27-4e36-a378-0531c195b1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:15 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Volume volume-7c6c51a2-b17d-4a7d-861a-5ca966723912 (7c6c51a2-b17d-4a7d-861a-5ca966723912): created successfully Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b06a3e2-ae27-4e36-a378-0531c195b1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Flow 'volume_create_manager' (f553330d-0cae-481b-b9ec-7b615fa7e5e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-97946163-7cc2-4675-af84-c1e09d310b76 tempest-VolumesGetTest-1052626978 None] Created volume successfully. Jun 19 04:21:16 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-25e07086-a23d-4686-a804-a3a84e4dd238 1073741824" returned: 0 in 0.820s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-25e07086-a23d-4686-a804-a3a84e4dd238 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:16 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-25e07086-a23d-4686-a804-a3a84e4dd238 Jun 19 04:21:16 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-7c6c51a2-b17d-4a7d-861a-5ca966723912-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Lock "cinder-7c6c51a2-b17d-4a7d-861a-5ca966723912-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-quobyte-7c6c51a2-b17d-4a7d-861a-5ca966723912" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-7c6c51a2-b17d-4a7d-861a-5ca966723912" acquired by "delete_volume" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c45f525-9e95-4454-bc68-cd09fe01cd84]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c6c51a2-b17d-4a7d-861a-5ca966723912 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:16 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c6c51a2-b17d-4a7d-861a-5ca966723912 Jun 19 04:21:16 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:16 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-25e07086-a23d-4686-a804-a3a84e4dd238" returned: 0 in 0.645s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-68539899-218a-4948-a0a1-1309b35e6a7e req-a095c226-97cb-4ba2-9dde-89934fc8b46b tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.500s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313d3915-e3a9-400a-aff6-62322aa4721a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25e07086-a23d-4686-a804-a3a84e4dd238', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2237f4-e107-48b9-b01c-aee0b77d0e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1434de-d510-4b99-b07a-5deb0bff60fd]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-68539899-218a-4948-a0a1-1309b35e6a7e req-a095c226-97cb-4ba2-9dde-89934fc8b46b tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:16 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Volume volume-25e07086-a23d-4686-a804-a3a84e4dd238 (25e07086-a23d-4686-a804-a3a84e4dd238): created successfully Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2237f4-e107-48b9-b01c-aee0b77d0e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Flow 'volume_create_manager' (d734c6e8-8495-43a2-990a-3f8ee71cd0b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:16 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-272b5887-3607-45f4-b070-ad33904bcb2e tempest-VolumesActionsTest-905428939 None] Created volume successfully. Jun 19 04:21:17 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570 Jun 19 04:21:17 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:17 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c6c51a2-b17d-4a7d-861a-5ca966723912" returned: 0 in 0.797s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c6c51a2-b17d-4a7d-861a-5ca966723912 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:17 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c6c51a2-b17d-4a7d-861a-5ca966723912 Jun 19 04:21:17 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:17 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-68539899-218a-4948-a0a1-1309b35e6a7e req-a095c226-97cb-4ba2-9dde-89934fc8b46b tempest-AttachVolumeTestJSON-665193495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570" returned: 0 in 0.806s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-68539899-218a-4948-a0a1-1309b35e6a7e req-a095c226-97cb-4ba2-9dde-89934fc8b46b tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.841s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2f7bd904-9cbd-4cf5-a2da-d61f9846a3a5 tempest-VolumesExtendTest-78090147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.868s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:17 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b550241-30a1-4162-afda-c764c6932be4]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2f7bd904-9cbd-4cf5-a2da-d61f9846a3a5 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-68539899-218a-4948-a0a1-1309b35e6a7e req-a095c226-97cb-4ba2-9dde-89934fc8b46b tempest-AttachVolumeTestJSON-665193495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-a426a355-7c3b-4986-a9c1-2126c83a4570', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bfef10c-ba72-4f09-9999-87e8ebf62430', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:21:17 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-68539899-218a-4948-a0a1-1309b35e6a7e req-a095c226-97cb-4ba2-9dde-89934fc8b46b tempest-AttachVolumeTestJSON-665193495 None] attachment_update completed successfully. Jun 19 04:21:17 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 Jun 19 04:21:17 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:18 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c6c51a2-b17d-4a7d-861a-5ca966723912" returned: 0 in 0.722s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-7c6c51a2-b17d-4a7d-861a-5ca966723912" released by "delete_volume" :: held 1.562s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Created reservations ['54864e70-3b10-48f2-b8c1-ed621f6ea447', '9b5d5710-8b30-47e6-8ae0-9d395fd00824', 'c822cafe-804e-44af-98e8-c4c87bf9bbcf', '2eac32ef-bd33-4a6b-83ca-9f076dfe3249'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Acquiring lock "cinder-25e07086-a23d-4686-a804-a3a84e4dd238-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:18 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:18 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Lock "cinder-25e07086-a23d-4686-a804-a3a84e4dd238-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Acquiring lock "cinder-quobyte-25e07086-a23d-4686-a804-a3a84e4dd238" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Lock "cinder-quobyte-25e07086-a23d-4686-a804-a3a84e4dd238" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdd81ef-cd07-4b3c-90e5-48d3c142765f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-25e07086-a23d-4686-a804-a3a84e4dd238 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:18 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-25e07086-a23d-4686-a804-a3a84e4dd238 Jun 19 04:21:18 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:18 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2f7bd904-9cbd-4cf5-a2da-d61f9846a3a5 tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124" returned: 0 in 0.883s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2f7bd904-9cbd-4cf5-a2da-d61f9846a3a5 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 2G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-dc46e831-6f02-4626-9227-30d033333f5a-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Lock "cinder-dc46e831-6f02-4626-9227-30d033333f5a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2f7bd904-9cbd-4cf5-a2da-d61f9846a3a5 tempest-VolumesExtendTest-78090147 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 2G" returned: 0 in 0.165s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2f7bd904-9cbd-4cf5-a2da-d61f9846a3a5 tempest-VolumesExtendTest-78090147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.110s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-quobyte-dc46e831-6f02-4626-9227-30d033333f5a" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:18 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-2f7bd904-9cbd-4cf5-a2da-d61f9846a3a5 tempest-VolumesExtendTest-78090147 None] Extend volume completed successfully. Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-dc46e831-6f02-4626-9227-30d033333f5a" acquired by "delete_volume" :: waited 0.034s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7453068-524f-4991-bea1-d83fef265dbb]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dc46e831-6f02-4626-9227-30d033333f5a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:19 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.771s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:19 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Deleted volume successfully. Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-316e50b8-aa67-444e-9f1c-9fdb27e288da tempest-VolumesGetTest-1052626978 None] Lock "cinder-7c6c51a2-b17d-4a7d-861a-5ca966723912-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:19 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dc46e831-6f02-4626-9227-30d033333f5a Jun 19 04:21:19 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:19 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-25e07086-a23d-4686-a804-a3a84e4dd238" returned: 0 in 0.888s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-25e07086-a23d-4686-a804-a3a84e4dd238 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:19 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-25e07086-a23d-4686-a804-a3a84e4dd238 Jun 19 04:21:19 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Acquiring lock "cinder-d5c1053b-af1a-4ad1-a646-ad69dd1992d4-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Lock "cinder-d5c1053b-af1a-4ad1-a646-ad69dd1992d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Acquiring lock "cinder-quobyte-af101639-b0e1-43ea-a7e6-eab552315124" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Lock "cinder-quobyte-af101639-b0e1-43ea-a7e6-eab552315124" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Acquiring lock "cinder-quobyte-d5c1053b-af1a-4ad1-a646-ad69dd1992d4" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Lock "cinder-quobyte-d5c1053b-af1a-4ad1-a646-ad69dd1992d4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Deleting offline snapshot d5c1053b-af1a-4ad1-a646-ad69dd1992d4 of volume af101639-b0e1-43ea-a7e6-eab552315124 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] snapshot_file for this snap is: volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[d417bae6-e98f-4b67-b999-c400f850f6e6]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:19 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 Jun 19 04:21:19 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:19 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dc46e831-6f02-4626-9227-30d033333f5a" returned: 0 in 0.895s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dc46e831-6f02-4626-9227-30d033333f5a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:19 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dc46e831-6f02-4626-9227-30d033333f5a Jun 19 04:21:19 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:20 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-25e07086-a23d-4686-a804-a3a84e4dd238" returned: 0 in 0.725s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Lock "cinder-quobyte-25e07086-a23d-4686-a804-a3a84e4dd238" released by "delete_volume" :: held 1.670s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Created reservations ['b945caee-8358-4abb-8c13-6b82f1d881e8', 'ca954456-6e40-4f18-8b72-075496e055cf', '7dafd2ef-b302-4b31-afe2-1b38c6777754', '15e5b3d2-338f-4d6e-a5f9-7236e0318d23'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:20 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:20 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:20 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4" returned: 0 in 0.780s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af101639-b0e1-43ea-a7e6-eab552315124(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad8a2a1-e842-46e5-acaf-cf3ef2b71462]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:20 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 Jun 19 04:21:20 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:20 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dc46e831-6f02-4626-9227-30d033333f5a" returned: 0 in 0.698s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-dc46e831-6f02-4626-9227-30d033333f5a" released by "delete_volume" :: held 1.645s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Created reservations ['edcc4eb2-c4ae-42d5-b39b-de28cbfae67d', '780ff2cb-3afd-4e4e-af6a-69c3f6442750', '2c2257f0-4a69-4cb4-a5fd-ecfaa8933d98', 'af0bb574-1c6c-4d59-bd6c-e6b6624521a9'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:20 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:20 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:21 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.850s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:21 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Deleted volume successfully. Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1ad77856-637d-4533-8462-c9342b71cbc3 tempest-VolumesActionsTest-905428939 None] Lock "cinder-25e07086-a23d-4686-a804-a3a84e4dd238-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:21 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124" returned: 0 in 1.087s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:21 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 Jun 19 04:21:21 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:21 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.837s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:21 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Deleted volume successfully. Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e3058cc1-1b12-411f-a7d1-814cc4b14361 tempest-VolumesGetTest-1052626978 None] Lock "cinder-dc46e831-6f02-4626-9227-30d033333f5a-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Flow 'volume_create_manager' (50807103-9c9b-41df-a618-c24855919098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b21689-a013-4fa3-bb7c-80d155893954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b21689-a013-4fa3-bb7c-80d155893954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1157524222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94bd9a5-d7ef-4852-bb98-3a488762f1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f519020c3675468f8a5bf34063561fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:22Z,use_quota=True,user_id='52ec8a9b33e849659eec2b9893fb8db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf10427-f383-4e7f-870f-1a710cd72f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acf10427-f383-4e7f-870f-1a710cd72f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849307d3-2d64-4fc0-9ba4-7db5fb715b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (849307d3-2d64-4fc0-9ba4-7db5fb715b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94bd9a5-d7ef-4852-bb98-3a488762f1aa', 'volume_name': 'volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d96209e-9391-41b9-ba1f-ee242f763bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d96209e-9391-41b9-ba1f-ee242f763bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3dd6ee-9320-4dcf-aed2-9f3527ed205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:21 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Volume c94bd9a5-d7ef-4852-bb98-3a488762f1aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa', 'volume_size': 1} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1157524222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94bd9a5-d7ef-4852-bb98-3a488762f1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f519020c3675468f8a5bf34063561fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:22Z,use_quota=True,user_id='52ec8a9b33e849659eec2b9893fb8db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Creating volume c94bd9a5-d7ef-4852-bb98-3a488762f1aa {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:21 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:21:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:21 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa 1073741824 Jun 19 04:21:21 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:22 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4" returned: 0 in 0.949s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:22 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4 Jun 19 04:21:22 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:23 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa 1073741824" returned: 0 in 1.077s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:23 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa Jun 19 04:21:23 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:23 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124.d5c1053b-af1a-4ad1-a646-ad69dd1992d4" returned: 0 in 0.735s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Lock "cinder-quobyte-d5c1053b-af1a-4ad1-a646-ad69dd1992d4" released by "_delete_snapshot" :: held 3.690s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Lock "cinder-quobyte-af101639-b0e1-43ea-a7e6-eab552315124" released by "delete_snapshot" :: held 3.727s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:23 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Created reservations ['666c4b7f-8558-4767-8390-cc2543acb775', '62a66d12-2efc-47ed-8961-062d787ff225', '4315a28e-c4f1-473a-b3cb-dd3cc22492cf', 'ca1dd347-d5d2-4847-aec3-1d66394a3a92'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:23 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Delete snapshot completed successfully. Jun 19 04:21:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-60976bce-ba71-4731-a0fa-ea3648ca5155 tempest-VolumesExtendTest-78090147 None] Lock "cinder-d5c1053b-af1a-4ad1-a646-ad69dd1992d4-delete_snapshot" released by "delete_snapshot" :: held 3.937s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Acquiring lock "cinder-af101639-b0e1-43ea-a7e6-eab552315124-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Lock "cinder-af101639-b0e1-43ea-a7e6-eab552315124-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:23 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=165,cinder:SELECT=147,cinder:INSERT=44,cinder:DELETE=16 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:21:23 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa" returned: 0 in 0.940s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:24 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=121,cinder:INSERT=44,cinder:UPDATE=172,cinder:DELETE=11 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:21:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3dd6ee-9320-4dcf-aed2-9f3527ed205b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb41d86-2ae1-4485-9c40-75eec0b3efe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:24 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Volume volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa (c94bd9a5-d7ef-4852-bb98-3a488762f1aa): created successfully Jun 19 04:21:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fb41d86-2ae1-4485-9c40-75eec0b3efe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Flow 'volume_create_manager' (50807103-9c9b-41df-a618-c24855919098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:24 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Acquiring lock "cinder-quobyte-af101639-b0e1-43ea-a7e6-eab552315124" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:24 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-0b9f4d17-5d2f-40f9-a239-fa2e1fb82d3a tempest-VolumesGetTest-1052626978 None] Created volume successfully. Jun 19 04:21:24 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Lock "cinder-quobyte-af101639-b0e1-43ea-a7e6-eab552315124" acquired by "delete_volume" :: waited 0.032s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:24 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b443ee-fc90-484e-8514-de68cae9ecbf]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:24 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 Jun 19 04:21:24 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:25 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124" returned: 0 in 1.004s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:25 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124 Jun 19 04:21:25 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:25 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-8171d75d-e4e8-45f6-b351-d09b70098f2b req-c6b15a6d-9616-438d-8ff8-05b8e52d19c8 tempest-AttachVolumeTestJSON-665193495 None] Terminate volume connection completed successfully. Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8171d75d-e4e8-45f6-b351-d09b70098f2b req-c6b15a6d-9616-438d-8ff8-05b8e52d19c8 tempest-AttachVolumeTestJSON-665193495 None] Deleting attachment d651d4cb-08c8-4b1f-abb0-41b7a393e8c5. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Flow 'volume_create_manager' (f54d6126-1669-4ac2-9850-f91ef3ea5b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df36306a-9cc4-43fb-82a4-83cc83958314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df36306a-9cc4-43fb-82a4-83cc83958314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1005650880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d07e6c7-a506-475d-9452-e693b0d2b9d2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f519020c3675468f8a5bf34063561fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c94bd9a5-d7ef-4852-bb98-3a488762f1aa,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:26Z,use_quota=True,user_id='52ec8a9b33e849659eec2b9893fb8db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01aa1012-8489-4133-bd2c-0a2139e3b4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01aa1012-8489-4133-bd2c-0a2139e3b4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c0fe42-81c2-41e4-a7a2-d2b4c0a0950d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c0fe42-81c2-41e4-a7a2-d2b4c0a0950d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8d07e6c7-a506-475d-9452-e693b0d2b9d2', 'volume_name': 'volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2', 'volume_size': 1, 'source_volid': 'c94bd9a5-d7ef-4852-bb98-3a488762f1aa', 'source_volstatus': 'available'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49acd961-9baa-4910-a2ce-6f44deb222a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49acd961-9baa-4910-a2ce-6f44deb222a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f4bc54-6a36-4986-b2e0-487b6c862467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:25 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Volume 8d07e6c7-a506-475d-9452-e693b0d2b9d2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2', 'volume_size': 1, 'source_volid': 'c94bd9a5-d7ef-4852-bb98-3a488762f1aa', 'source_volstatus': 'available'} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:25 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Cloning volume c94bd9a5-d7ef-4852-bb98-3a488762f1aa to volume 8d07e6c7-a506-475d-9452-e693b0d2b9d2 Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Creating offline snapshot d233135f-c22e-403c-856a-5e885dd98066 of volume c94bd9a5-d7ef-4852-bb98-3a488762f1aa {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5edc10-dca6-407d-8c49-9c2126aa822d]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:26 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-af101639-b0e1-43ea-a7e6-eab552315124" returned: 0 in 0.876s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Lock "cinder-quobyte-af101639-b0e1-43ea-a7e6-eab552315124" released by "delete_volume" :: held 1.985s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:26 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Created reservations ['9fb358dd-4567-4e8b-ba58-2984d3188a9a', '7ccc8c81-4e2a-4dba-9126-a732ad4e7fab', 'fce8b7fe-ab18-4735-b7b2-1c943e1f24ff', '05e5b2d8-e4ef-412c-bdbe-be2d0158305c'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:26 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa Jun 19 04:21:26 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:26 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:26 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:27 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa" returned: 0 in 1.049s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:27 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 1G Jun 19 04:21:27 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:27 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.862s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:27 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:27 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Deleted volume successfully. Jun 19 04:21:27 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2a88209d-1873-4826-93d2-c23b1f82af55 tempest-VolumesExtendTest-78090147 None] Lock "cinder-af101639-b0e1-43ea-a7e6-eab552315124-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:28 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 1G" returned: 0 in 1.085s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:28 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 Jun 19 04:21:28 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:29 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066" returned: 0 in 0.987s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:29 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 is being set with open permissions: ugo+rw Jun 19 04:21:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:29 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 Jun 19 04:21:29 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:29 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-de0cd758-dfc6-427c-9e71-0795cdd592e7 req-c58e7fa1-3b20-48a4-82b1-3989ecf220b5 tempest-AttachVolumeTestJSON-665193495 None] Terminate volume connection completed successfully. Jun 19 04:21:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-de0cd758-dfc6-427c-9e71-0795cdd592e7 req-c58e7fa1-3b20-48a4-82b1-3989ecf220b5 tempest-AttachVolumeTestJSON-665193495 None] Deleting attachment 5bfef10c-ba72-4f09-9999-87e8ebf62430. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:21:29 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066" returned: 0 in 0.838s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:30 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.info Jun 19 04:21:30 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:30 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Flow 'volume_create_manager' (e728f809-9741-43a5-9ad2-a0d703e97a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbcc308-4eba-4fc9-9b62-feb4103992f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbcc308-4eba-4fc9-9b62-feb4103992f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-196891977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f8f2d5-52d9-4b14-b94b-374452414099,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='583a99792c8242b58334cd1a83553506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:30Z,use_quota=True,user_id='480520eaa0c54d24881b681d1f5991eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d3b67b-c103-457e-b432-0d48f6016f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d3b67b-c103-457e-b432-0d48f6016f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684a26df-7a6b-4237-9446-72789f605cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684a26df-7a6b-4237-9446-72789f605cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f8f2d5-52d9-4b14-b94b-374452414099', 'volume_name': 'volume-14f8f2d5-52d9-4b14-b94b-374452414099', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ce549f-11a5-4dec-ab16-9519314f60f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ce549f-11a5-4dec-ab16-9519314f60f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a367223-e190-4e03-b1a2-1d257095334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:30 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Volume 14f8f2d5-52d9-4b14-b94b-374452414099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f8f2d5-52d9-4b14-b94b-374452414099', 'volume_size': 1} Jun 19 04:21:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:30 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.info" returned: 0 in 0.833s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:30 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.info is being set with open permissions: ugo+rw Jun 19 04:21:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:30 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.info Jun 19 04:21:30 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:31 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.info" returned: 0 in 0.798s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:31 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-quobyte-8d07e6c7-a506-475d-9452-e693b0d2b9d2" by "_copy_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:31 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-8d07e6c7-a506-475d-9452-e693b0d2b9d2" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] snapshot: d233135f-c22e-403c-856a-5e885dd98066, volume: 8d07e6c7-a506-475d-9452-e693b0d2b9d2, {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:21:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:31 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e1ec29-e218-4c50-8973-fe0d9abd956f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:31 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 Jun 19 04:21:31 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:32 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066" returned: 0 in 0.798s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:21:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Creating direct copy from snapshot {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:21:32 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5b9f8b-e3dc-47d1-8ce9-db3ced5a5e53]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:32 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa Jun 19 04:21:32 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:33 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa" returned: 0 in 0.971s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:33 devstack cinder-volume[93530]: DEBUG cinder.utils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Path /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2 not found in is_blk_device check {{(pid=93530) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:21:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:33 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2 Jun 19 04:21:33 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:39 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2" returned: 0 in 6.029s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:39 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f240365-6247-4969-ae84-d63476015d4a]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:39 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa Jun 19 04:21:39 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:40 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=12,cinder:SELECT=11,cinder:INSERT=3 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:21:40 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa" returned: 0 in 0.961s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:40 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Image conversion details: src /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:21:40 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Converted 1024.00 MB image at 169.80 MB/s Jun 19 04:21:40 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2 is being set with open permissions: ugo+rw Jun 19 04:21:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:40 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:DELETE=2,cinder:SELECT=12,cinder:UPDATE=9,cinder:INSERT=3 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:21:40 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2 Jun 19 04:21:40 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:41 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2" returned: 0 in 0.716s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-8d07e6c7-a506-475d-9452-e693b0d2b9d2" released by "_copy_volume_from_snapshot" :: held 9.580s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-quobyte-d233135f-c22e-403c-856a-5e885dd98066" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-d233135f-c22e-403c-856a-5e885dd98066" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Deleting offline snapshot d233135f-c22e-403c-856a-5e885dd98066 of volume c94bd9a5-d7ef-4852-bb98-3a488762f1aa {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] snapshot_file for this snap is: volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d80cca-2f47-4866-8389-94c7c8f3a17f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:41 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 Jun 19 04:21:41 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "cinder-a426a355-7c3b-4986-a9c1-2126c83a4570-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Lock "cinder-a426a355-7c3b-4986-a9c1-2126c83a4570-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "cinder-quobyte-a426a355-7c3b-4986-a9c1-2126c83a4570" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Lock "cinder-quobyte-a426a355-7c3b-4986-a9c1-2126c83a4570" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fac9c2-48a6-41bd-876c-7d46c27819a4]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Flow 'volume_create_manager' (9013a754-cbb3-4f47-9cae-005db7fa0a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85b8a32-0df4-4a6c-b224-c0d636bdbec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85b8a32-0df4-4a6c-b224-c0d636bdbec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1145096023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ee5671-7a46-4308-bab0-0432d6eb3342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb171b4dc704400a5529c9ace3d81c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:42Z,use_quota=True,user_id='594e4941a9c04305855647252d1bf738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d04e7f2-8388-489c-bfcc-00d3fd11487c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d04e7f2-8388-489c-bfcc-00d3fd11487c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a194a34-64f4-495a-9bb8-d1ba608a203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:41 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570 Jun 19 04:21:41 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a194a34-64f4-495a-9bb8-d1ba608a203f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8ee5671-7a46-4308-bab0-0432d6eb3342', 'volume_name': 'volume-b8ee5671-7a46-4308-bab0-0432d6eb3342', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33856172-c180-481f-ad27-84f97edacc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33856172-c180-481f-ad27-84f97edacc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4f78b5-3530-44a6-ae29-e12dea2ef3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:41 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Volume b8ee5671-7a46-4308-bab0-0432d6eb3342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8ee5671-7a46-4308-bab0-0432d6eb3342', 'volume_size': 1} Jun 19 04:21:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:42 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066" returned: 0 in 0.890s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:42 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:42 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b2a317-1982-47ab-8e80-23a7519e5233]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:42 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa Jun 19 04:21:42 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:42 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570" returned: 0 in 0.757s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:42 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570 Jun 19 04:21:42 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:43 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa" returned: 0 in 0.831s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:43 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 Jun 19 04:21:43 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:43 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a426a355-7c3b-4986-a9c1-2126c83a4570" returned: 0 in 0.675s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Lock "cinder-quobyte-a426a355-7c3b-4986-a9c1-2126c83a4570" released by "delete_volume" :: held 1.483s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Created reservations ['b2b00290-f6a2-4038-a9a3-3feb2ae97ec0', '7e21f883-30d6-49c3-82fb-8ac8ad812321', '8c06bb5e-4184-4c49-9a14-b76a8ceff955', '842f823c-11a3-456e-ab85-5146efc79f5b'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:43 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:43 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "cinder-91e904be-04e7-4702-b328-68cc1decdccc-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:43 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066" returned: 0 in 0.850s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Lock "cinder-91e904be-04e7-4702-b328-68cc1decdccc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:43 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066 Jun 19 04:21:43 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "cinder-quobyte-91e904be-04e7-4702-b328-68cc1decdccc" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Lock "cinder-quobyte-91e904be-04e7-4702-b328-68cc1decdccc" acquired by "delete_volume" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bbd2d6-36c0-4f9a-94e6-ddc07902edb3]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:44 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.677s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:44 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Deleted volume successfully. Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b9f52b9b-f988-4698-ae73-aabf68add046 tempest-AttachVolumeTestJSON-665193495 None] Lock "cinder-a426a355-7c3b-4986-a9c1-2126c83a4570-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:44 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc Jun 19 04:21:44 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:44 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa.d233135f-c22e-403c-856a-5e885dd98066" returned: 0 in 0.767s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-d233135f-c22e-403c-856a-5e885dd98066" released by "_delete_snapshot" :: held 3.442s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.830s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.173s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-196891977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f8f2d5-52d9-4b14-b94b-374452414099,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='583a99792c8242b58334cd1a83553506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:30Z,use_quota=True,user_id='480520eaa0c54d24881b681d1f5991eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Creating volume 14f8f2d5-52d9-4b14-b94b-374452414099 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:44 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-14f8f2d5-52d9-4b14-b94b-374452414099 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:44 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc" returned: 0 in 0.776s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42f4bc54-6a36-4986-b2e0-487b6c862467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2', 'volume_size': 1, 'source_volid': 'c94bd9a5-d7ef-4852-bb98-3a488762f1aa', 'source_volstatus': 'available'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:44 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-14f8f2d5-52d9-4b14-b94b-374452414099 1073741824 Jun 19 04:21:44 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947ce330-a97f-4ae5-a6b7-810db5521a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:44 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Volume volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2 (8d07e6c7-a506-475d-9452-e693b0d2b9d2): created successfully Jun 19 04:21:44 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc Jun 19 04:21:44 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947ce330-a97f-4ae5-a6b7-810db5521a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Flow 'volume_create_manager' (f54d6126-1669-4ac2-9850-f91ef3ea5b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:44 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-54294d7e-af47-4561-95af-156487035d0b tempest-VolumesGetTest-1052626978 None] Created volume successfully. Jun 19 04:21:45 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-91e904be-04e7-4702-b328-68cc1decdccc" returned: 0 in 0.775s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Lock "cinder-quobyte-91e904be-04e7-4702-b328-68cc1decdccc" released by "delete_volume" :: held 1.610s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:45 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Created reservations ['2edc8d70-4370-415b-928b-e928bb6a7767', 'd4de286b-8abc-4459-88a0-a929822a40ec', '2dbdaf9f-2701-4c4a-86cf-5fa2b9b3445f', 'ba60d606-f274-4bbb-9e91-0e604993c6fb'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:45 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-14f8f2d5-52d9-4b14-b94b-374452414099 1073741824" returned: 0 in 0.904s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-14f8f2d5-52d9-4b14-b94b-374452414099 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:45 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-14f8f2d5-52d9-4b14-b94b-374452414099 Jun 19 04:21:45 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:45 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:45 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Flow 'volume_create_manager' (40f5f054-0dfb-4419-bb38-64b56fe9508b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abca5a1d-5fd4-4728-9dd4-9440759e54dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abca5a1d-5fd4-4728-9dd4-9440759e54dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1290624671',display_name='tempest-VolumesGetTest-Volume-1173257977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c07570d-fa6c-4956-bbb0-2cefe67f84fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f519020c3675468f8a5bf34063561fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:46Z,use_quota=True,user_id='52ec8a9b33e849659eec2b9893fb8db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca24be9-c9de-4c07-9027-51c740c451d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ca24be9-c9de-4c07-9027-51c740c451d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95def51f-b10a-4ac7-a62f-c7280289fd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95def51f-b10a-4ac7-a62f-c7280289fd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c07570d-fa6c-4956-bbb0-2cefe67f84fa', 'volume_name': 'volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0843e1f6-0332-44e2-ad53-efe20e690fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0843e1f6-0332-44e2-ad53-efe20e690fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067c1937-53c6-4b90-9778-54c7c9ed44e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:46 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Volume 5c07570d-fa6c-4956-bbb0-2cefe67f84fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa', 'volume_size': 1} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "cinder-54466a52-6ac2-4401-9bc9-c5b03f88bec1-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Lock "cinder-54466a52-6ac2-4401-9bc9-c5b03f88bec1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "cinder-quobyte-54466a52-6ac2-4401-9bc9-c5b03f88bec1" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Lock "cinder-quobyte-54466a52-6ac2-4401-9bc9-c5b03f88bec1" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5e1122-6496-4618-9497-ca011acf5048]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:46 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.699s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:46 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Deleted volume successfully. Jun 19 04:21:46 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1 Jun 19 04:21:46 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a40967b4-f5b7-47ce-933c-f5914f1aa4ba tempest-AttachVolumeTestJSON-665193495 None] Lock "cinder-91e904be-04e7-4702-b328-68cc1decdccc-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:46 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-14f8f2d5-52d9-4b14-b94b-374452414099" returned: 0 in 0.827s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.641s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1145096023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ee5671-7a46-4308-bab0-0432d6eb3342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb171b4dc704400a5529c9ace3d81c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:42Z,use_quota=True,user_id='594e4941a9c04305855647252d1bf738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Creating volume b8ee5671-7a46-4308-bab0-0432d6eb3342 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:46 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8ee5671-7a46-4308-bab0-0432d6eb3342 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:46 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8ee5671-7a46-4308-bab0-0432d6eb3342 1073741824 Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a367223-e190-4e03-b1a2-1d257095334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f8f2d5-52d9-4b14-b94b-374452414099', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:46 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9777d3-7c5d-4651-b683-28c44f96f6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:46 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Volume volume-14f8f2d5-52d9-4b14-b94b-374452414099 (14f8f2d5-52d9-4b14-b94b-374452414099): created successfully Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9777d3-7c5d-4651-b683-28c44f96f6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Flow 'volume_create_manager' (e728f809-9741-43a5-9ad2-a0d703e97a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:46 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e2305735-7525-4c83-a438-2c5f4ef4a8b1 tempest-VolumesListTestJSON-1256609378 None] Created volume successfully. Jun 19 04:21:47 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1" returned: 0 in 0.811s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:47 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1 Jun 19 04:21:47 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:47 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8ee5671-7a46-4308-bab0-0432d6eb3342 1073741824" returned: 0 in 0.955s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8ee5671-7a46-4308-bab0-0432d6eb3342 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:47 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8ee5671-7a46-4308-bab0-0432d6eb3342 Jun 19 04:21:47 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Flow 'volume_create_manager' (70fd0fd8-8712-443f-b8a4-29e6d9a260bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88846d34-d4a5-4647-8b06-105adbacbbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88846d34-d4a5-4647-8b06-105adbacbbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1265384274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a43d95-b0f5-469e-908f-89e975926794,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='583a99792c8242b58334cd1a83553506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:48Z,use_quota=True,user_id='480520eaa0c54d24881b681d1f5991eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a3594f-d98d-4089-92c4-dc09ad991891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55a3594f-d98d-4089-92c4-dc09ad991891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad97533a-a8f3-4b96-a1b0-2f4018a3b23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad97533a-a8f3-4b96-a1b0-2f4018a3b23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67a43d95-b0f5-469e-908f-89e975926794', 'volume_name': 'volume-67a43d95-b0f5-469e-908f-89e975926794', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b211af98-3d2f-4e9a-bb56-366764ac1ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b211af98-3d2f-4e9a-bb56-366764ac1ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313bba2f-7c7f-427b-9b64-82a0d8052226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:47 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Volume 67a43d95-b0f5-469e-908f-89e975926794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67a43d95-b0f5-469e-908f-89e975926794', 'volume_size': 1} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:47 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-54466a52-6ac2-4401-9bc9-c5b03f88bec1" returned: 0 in 0.681s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Lock "cinder-quobyte-54466a52-6ac2-4401-9bc9-c5b03f88bec1" released by "delete_volume" :: held 1.533s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:47 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Created reservations ['b2bfab6b-a805-499f-b709-0e14e766309d', 'fd76fdd9-1c75-417c-af3a-24363b523cb2', 'bff778a3-b351-4aa6-b46a-7868ffc61d92', '0226a336-1141-4dee-b408-b0561a163e71'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:48 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:48 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:48 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8ee5671-7a46-4308-bab0-0432d6eb3342" returned: 0 in 0.683s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.989s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1290624671',display_name='tempest-VolumesGetTest-Volume-1173257977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c07570d-fa6c-4956-bbb0-2cefe67f84fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f519020c3675468f8a5bf34063561fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:46Z,use_quota=True,user_id='52ec8a9b33e849659eec2b9893fb8db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Creating volume 5c07570d-fa6c-4956-bbb0-2cefe67f84fa {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:48 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4f78b5-3530-44a6-ae29-e12dea2ef3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8ee5671-7a46-4308-bab0-0432d6eb3342', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:48 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa 1073741824 Jun 19 04:21:48 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4316b65b-0089-495d-9f65-2e76d817c3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:48 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Volume volume-b8ee5671-7a46-4308-bab0-0432d6eb3342 (b8ee5671-7a46-4308-bab0-0432d6eb3342): created successfully Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4316b65b-0089-495d-9f65-2e76d817c3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Flow 'volume_create_manager' (9013a754-cbb3-4f47-9cae-005db7fa0a85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:48 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-de110a52-ef1b-4291-bf95-8965465aeb1a tempest-VolumesTransfersV357Test-2068032472 None] Created volume successfully. Jun 19 04:21:48 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.684s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:48 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Deleted volume successfully. Jun 19 04:21:48 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-045419f6-c9ce-4b45-a09b-177b8de94bcb tempest-AttachVolumeTestJSON-665193495 None] Lock "cinder-54466a52-6ac2-4401-9bc9-c5b03f88bec1-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:49 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa 1073741824" returned: 0 in 0.960s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:49 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa Jun 19 04:21:49 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:49 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa" returned: 0 in 0.734s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1265384274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a43d95-b0f5-469e-908f-89e975926794,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='583a99792c8242b58334cd1a83553506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:48Z,use_quota=True,user_id='480520eaa0c54d24881b681d1f5991eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Creating volume 67a43d95-b0f5-469e-908f-89e975926794 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:50 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-67a43d95-b0f5-469e-908f-89e975926794 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:50 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-67a43d95-b0f5-469e-908f-89e975926794 1073741824 Jun 19 04:21:50 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067c1937-53c6-4b90-9778-54c7c9ed44e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a52577-a5b6-4d4e-8d37-b44c4f696cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:50 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-7c935165-3422-47e5-a857-b4afe9ea5331 tempest-VolumesTransfersV357Test-1212968367 None] Transfer volume completed successfully. Jun 19 04:21:50 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Volume volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa (5c07570d-fa6c-4956-bbb0-2cefe67f84fa): created successfully Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a52577-a5b6-4d4e-8d37-b44c4f696cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Flow 'volume_create_manager' (40f5f054-0dfb-4419-bb38-64b56fe9508b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:50 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-8a450592-b636-4962-a958-afdfec7eb8ee tempest-VolumesGetTest-1052626978 None] Created volume successfully. Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-5c07570d-fa6c-4956-bbb0-2cefe67f84fa-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Lock "cinder-5c07570d-fa6c-4956-bbb0-2cefe67f84fa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-quobyte-5c07570d-fa6c-4956-bbb0-2cefe67f84fa" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-5c07570d-fa6c-4956-bbb0-2cefe67f84fa" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa1c5ae-6269-4895-8f90-7c8ddd7cbefe]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:50 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa Jun 19 04:21:50 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Acquiring lock "cinder-b8ee5671-7a46-4308-bab0-0432d6eb3342-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Lock "cinder-b8ee5671-7a46-4308-bab0-0432d6eb3342-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Acquiring lock "cinder-quobyte-b8ee5671-7a46-4308-bab0-0432d6eb3342" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Lock "cinder-quobyte-b8ee5671-7a46-4308-bab0-0432d6eb3342" acquired by "delete_volume" :: waited 0.034s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:51 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[e877e459-c7a7-4c22-b786-6492a795a31b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8ee5671-7a46-4308-bab0-0432d6eb3342 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:51 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-67a43d95-b0f5-469e-908f-89e975926794 1073741824" returned: 0 in 1.277s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-67a43d95-b0f5-469e-908f-89e975926794 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:51 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-67a43d95-b0f5-469e-908f-89e975926794 Jun 19 04:21:51 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:51 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8ee5671-7a46-4308-bab0-0432d6eb3342 Jun 19 04:21:51 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:51 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa" returned: 0 in 1.091s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:51 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa Jun 19 04:21:51 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:52 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-67a43d95-b0f5-469e-908f-89e975926794" returned: 0 in 0.948s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] <== create_volume: return (2275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.277s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313bba2f-7c7f-427b-9b64-82a0d8052226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a43d95-b0f5-469e-908f-89e975926794', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ababd5b0-8d72-4a75-95e8-4a946eb99a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:52 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Volume volume-67a43d95-b0f5-469e-908f-89e975926794 (67a43d95-b0f5-469e-908f-89e975926794): created successfully Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ababd5b0-8d72-4a75-95e8-4a946eb99a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Flow 'volume_create_manager' (70fd0fd8-8712-443f-b8a4-29e6d9a260bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:52 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8ee5671-7a46-4308-bab0-0432d6eb3342" returned: 0 in 1.115s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8ee5671-7a46-4308-bab0-0432d6eb3342 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:52 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-66f38a70-3d2b-4fdd-bba8-c6f1efa5b7c4 tempest-VolumesListTestJSON-1256609378 None] Created volume successfully. Jun 19 04:21:52 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8ee5671-7a46-4308-bab0-0432d6eb3342 Jun 19 04:21:52 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:52 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5c07570d-fa6c-4956-bbb0-2cefe67f84fa" returned: 0 in 0.859s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-5c07570d-fa6c-4956-bbb0-2cefe67f84fa" released by "delete_volume" :: held 2.016s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Created reservations ['91d07a30-45dd-4b5d-b516-57fd9ddea2e0', 'fb0a5a85-dd6d-418d-a419-fdf56924dde2', 'a83eb47d-3e6d-434f-93f6-fe6b3b4939b2', '16098ad8-7dc6-4577-9356-97b6150a3888'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:52 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:52 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-8d07e6c7-a506-475d-9452-e693b0d2b9d2-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Lock "cinder-8d07e6c7-a506-475d-9452-e693b0d2b9d2-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-quobyte-8d07e6c7-a506-475d-9452-e693b0d2b9d2" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-8d07e6c7-a506-475d-9452-e693b0d2b9d2" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1910d9-310a-4366-89c7-21e995040219]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:53 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2 Jun 19 04:21:53 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:53 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-b8ee5671-7a46-4308-bab0-0432d6eb3342" returned: 0 in 1.160s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Lock "cinder-quobyte-b8ee5671-7a46-4308-bab0-0432d6eb3342" released by "delete_volume" :: held 2.335s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Created reservations ['c8d244aa-dbc1-4d98-a3ba-bea4c49c44f6', '9d993c83-987a-4290-83d9-b7c2d7d90296', 'b5736372-c665-4d26-8a02-9e9ab3fb9fac', '3c67fa44-5da7-4171-a75c-875305a25df6'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:53 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:53 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:53 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.984s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:53 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Deleted volume successfully. Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-63a39719-610b-4d47-8cc4-8e37857f58e0 tempest-VolumesGetTest-1052626978 None] Lock "cinder-5c07570d-fa6c-4956-bbb0-2cefe67f84fa-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:53 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Flow 'volume_create_manager' (34735197-0696-41b6-ac47-d6485446befd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0871c0a-671a-4dc6-ab31-30b65534b42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0871c0a-671a-4dc6-ab31-30b65534b42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-220118387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5fa147-592d-4f6b-826d-cb338d554622,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='583a99792c8242b58334cd1a83553506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:54Z,use_quota=True,user_id='480520eaa0c54d24881b681d1f5991eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecdf0ec9-6285-43a6-82b4-026454f74cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecdf0ec9-6285-43a6-82b4-026454f74cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04099cf-e347-4a1f-9ab9-44365a0214ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d04099cf-e347-4a1f-9ab9-44365a0214ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5fa147-592d-4f6b-826d-cb338d554622', 'volume_name': 'volume-ef5fa147-592d-4f6b-826d-cb338d554622', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4a443e-3b8b-40f5-b183-dbfcdfe2fdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4a443e-3b8b-40f5-b183-dbfcdfe2fdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611265c9-971a-4b7a-9c23-f868eb8cedd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:54 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Volume ef5fa147-592d-4f6b-826d-cb338d554622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5fa147-592d-4f6b-826d-cb338d554622', 'volume_size': 1} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-220118387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5fa147-592d-4f6b-826d-cb338d554622,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='583a99792c8242b58334cd1a83553506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:54Z,use_quota=True,user_id='480520eaa0c54d24881b681d1f5991eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Creating volume ef5fa147-592d-4f6b-826d-cb338d554622 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:54 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ef5fa147-592d-4f6b-826d-cb338d554622 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:54 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ef5fa147-592d-4f6b-826d-cb338d554622 1073741824 Jun 19 04:21:54 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:54 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2" returned: 0 in 1.130s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:54 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2 Jun 19 04:21:54 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:54 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.015s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:54 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Deleted volume successfully. Jun 19 04:21:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-56560dcc-b6ab-4088-95af-a86f11d3f487 tempest-VolumesTransfersV357Test-472891486 None] Lock "cinder-b8ee5671-7a46-4308-bab0-0432d6eb3342-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:55 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8d07e6c7-a506-475d-9452-e693b0d2b9d2" returned: 0 in 0.953s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-8d07e6c7-a506-475d-9452-e693b0d2b9d2" released by "delete_volume" :: held 2.183s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Created reservations ['54b14c1d-5ed0-47cd-9c6a-3f7aea9f870e', '9926fccf-791b-464a-8a74-c65f281ca1d2', 'b0188e2d-19b3-4b6b-b29e-782092ad336c', '24f22f9d-0e29-418d-8c64-0659d0bed5c3'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:55 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ef5fa147-592d-4f6b-826d-cb338d554622 1073741824" returned: 0 in 1.249s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ef5fa147-592d-4f6b-826d-cb338d554622 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:55 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ef5fa147-592d-4f6b-826d-cb338d554622 Jun 19 04:21:55 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Flow 'volume_create_manager' (9fbce9f2-96b8-499f-8843-074795c3b3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d619790c-35b7-47cb-94e9-cf000c8242b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d619790c-35b7-47cb-94e9-cf000c8242b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1724044742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223f0e6b-81f8-4ca5-a921-e6d424f4481b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb171b4dc704400a5529c9ace3d81c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:55Z,use_quota=True,user_id='594e4941a9c04305855647252d1bf738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5d0c6c-ac6b-46eb-9a6b-7d9cfc9821d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5d0c6c-ac6b-46eb-9a6b-7d9cfc9821d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86b8585-6bcd-4ad8-8eb1-b3b14ce54d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86b8585-6bcd-4ad8-8eb1-b3b14ce54d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223f0e6b-81f8-4ca5-a921-e6d424f4481b', 'volume_name': 'volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc5bd73-4ee0-487e-8698-d3da26f7dd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc5bd73-4ee0-487e-8698-d3da26f7dd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71612d2c-150b-4166-9dfd-80e1afd3cc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:55 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Volume 223f0e6b-81f8-4ca5-a921-e6d424f4481b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b', 'volume_size': 1} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:55 devstack sudo[103364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:55 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:56 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ef5fa147-592d-4f6b-826d-cb338d554622" returned: 0 in 0.765s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] <== create_volume: return (2142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.148s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.659s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1724044742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223f0e6b-81f8-4ca5-a921-e6d424f4481b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abb171b4dc704400a5529c9ace3d81c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:55Z,use_quota=True,user_id='594e4941a9c04305855647252d1bf738',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Creating volume 223f0e6b-81f8-4ca5-a921-e6d424f4481b {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:56 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611265c9-971a-4b7a-9c23-f868eb8cedd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5fa147-592d-4f6b-826d-cb338d554622', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6ff120-8072-4582-b294-b410e592e66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:56 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b 1073741824 Jun 19 04:21:56 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:56 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Volume volume-ef5fa147-592d-4f6b-826d-cb338d554622 (ef5fa147-592d-4f6b-826d-cb338d554622): created successfully Jun 19 04:21:56 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6ff120-8072-4582-b294-b410e592e66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Flow 'volume_create_manager' (34735197-0696-41b6-ac47-d6485446befd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.745s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:56 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d2b3791e-6766-45aa-8aa7-832e80dbf0f1 tempest-VolumesListTestJSON-1256609378 None] Created volume successfully. Jun 19 04:21:56 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Deleted volume successfully. Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b0d0240-8b52-4d12-9687-7f4a778f6115 tempest-VolumesGetTest-1052626978 None] Lock "cinder-8d07e6c7-a506-475d-9452-e693b0d2b9d2-delete_volume" released by "delete_volume" :: held 3.375s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-c94bd9a5-d7ef-4852-bb98-3a488762f1aa-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Lock "cinder-c94bd9a5-d7ef-4852-bb98-3a488762f1aa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-quobyte-c94bd9a5-d7ef-4852-bb98-3a488762f1aa" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-c94bd9a5-d7ef-4852-bb98-3a488762f1aa" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a22f6b4-d333-4427-9a39-a2d5aace7d5b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:56 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa Jun 19 04:21:56 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:57 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b 1073741824" returned: 0 in 1.132s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:57 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b Jun 19 04:21:57 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:57 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa" returned: 0 in 1.098s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:57 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa Jun 19 04:21:57 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:58 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b" returned: 0 in 0.801s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71612d2c-150b-4166-9dfd-80e1afd3cc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e922d2ef-d5dc-49b1-a0ba-faba01c0ff0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:58 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Volume volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b (223f0e6b-81f8-4ca5-a921-e6d424f4481b): created successfully Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e922d2ef-d5dc-49b1-a0ba-faba01c0ff0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Flow 'volume_create_manager' (9fbce9f2-96b8-499f-8843-074795c3b3f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:58 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-3b82c3c0-7870-490c-8cd1-fc1770602d6f tempest-VolumesTransfersV357Test-2068032472 None] Created volume successfully. Jun 19 04:21:58 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c94bd9a5-d7ef-4852-bb98-3a488762f1aa" returned: 0 in 0.800s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-c94bd9a5-d7ef-4852-bb98-3a488762f1aa" released by "delete_volume" :: held 1.986s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Created reservations ['039ae096-066c-4c5b-99df-81352ddc0c47', 'f1fdc563-238d-410b-a50a-48b435c9c6ea', 'e129fbea-0993-4e6d-b193-ec8c32e0c28c', 'c6355f5b-0dcb-4892-b1aa-5a95ca7cfda8'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:58 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:58 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:58 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:21:58 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Acquiring lock "cinder-223f0e6b-81f8-4ca5-a921-e6d424f4481b-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Lock "cinder-223f0e6b-81f8-4ca5-a921-e6d424f4481b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Acquiring lock "cinder-quobyte-223f0e6b-81f8-4ca5-a921-e6d424f4481b" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Lock "cinder-quobyte-223f0e6b-81f8-4ca5-a921-e6d424f4481b" acquired by "delete_volume" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:59 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5521dc-cfc1-4d30-861b-77b2c258f77b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:59 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b Jun 19 04:21:59 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:59 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.019s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:59 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Deleted volume successfully. Jun 19 04:21:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a877697d-a84e-433d-b327-ae09d58a16e9 tempest-VolumesGetTest-1052626978 None] Lock "cinder-c94bd9a5-d7ef-4852-bb98-3a488762f1aa-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Flow 'volume_create_manager' (eee73ad5-7405-43c7-92fb-df50caaf74c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:00 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef764738-2f7e-4624-8aa2-a7804decf66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.391s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef764738-2f7e-4624-8aa2-a7804decf66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2070045382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad9b822-580e-445c-84a4-f9da0be3c723,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f519020c3675468f8a5bf34063561fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:00Z,use_quota=True,user_id='52ec8a9b33e849659eec2b9893fb8db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd9ecce-810b-4188-a81e-e44126ce4d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebd9ecce-810b-4188-a81e-e44126ce4d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd600981-f522-4ca0-8262-2fdb5b84833c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.image.glance [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Creating Keystone auth plugin from conf {{(pid=93530) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:22:00 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b" returned: 0 in 1.172s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:00 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b Jun 19 04:22:00 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "cinder-ef5fa147-592d-4f6b-826d-cb338d554622-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd600981-f522-4ca0-8262-2fdb5b84833c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ad9b822-580e-445c-84a4-f9da0be3c723', 'volume_name': 'volume-1ad9b822-580e-445c-84a4-f9da0be3c723', 'volume_size': 1, 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41c991745fb845ed91d69be55aec3c73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f866865f-2633-4950-8bcf-643f9b96c123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f866865f-2633-4950-8bcf-643f9b96c123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d126f6-6fb6-4481-a8de-b1b77dc990a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:00 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Volume 1ad9b822-580e-445c-84a4-f9da0be3c723: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ad9b822-580e-445c-84a4-f9da0be3c723', 'volume_size': 1, 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41c991745fb845ed91d69be55aec3c73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Trying to clone 1ad9b822-580e-445c-84a4-f9da0be3c723 from image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]). {{(pid=93530) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:22:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Lock "cinder-ef5fa147-592d-4f6b-826d-cb338d554622-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "cinder-quobyte-ef5fa147-592d-4f6b-826d-cb338d554622" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Lock "cinder-quobyte-ef5fa147-592d-4f6b-826d-cb338d554622" acquired by "delete_volume" :: waited 0.031s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[9146b25a-498b-404c-804d-82acfc956a28]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ef5fa147-592d-4f6b-826d-cb338d554622 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:01 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ef5fa147-592d-4f6b-826d-cb338d554622 Jun 19 04:22:01 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_w2c5ib7ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:22:01 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Image download 20.69 MB at 20.69 MB/s Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb3738e-b21d-4706-9e2d-198588d5224f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_w2c5ib7ydevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:01 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-223f0e6b-81f8-4ca5-a921-e6d424f4481b" returned: 0 in 1.078s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:01 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_w2c5ib7ydevstack@QuobyteHD Jun 19 04:22:01 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Lock "cinder-quobyte-223f0e6b-81f8-4ca5-a921-e6d424f4481b" released by "delete_volume" :: held 2.326s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Created reservations ['5f2a026c-305c-40a1-b63a-07c6752af154', 'a1fdd238-62c1-4c73-b428-0929cb6aafcb', '48a05944-5e05-4b24-b486-c35bf3e54125', '22a84c41-2921-4b89-ad59-72c597f6da75'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:01 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:22:01 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:02 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ef5fa147-592d-4f6b-826d-cb338d554622" returned: 0 in 0.957s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ef5fa147-592d-4f6b-826d-cb338d554622 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:02 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ef5fa147-592d-4f6b-826d-cb338d554622 Jun 19 04:22:02 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:02 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_w2c5ib7ydevstack@QuobyteHD" returned: 0 in 0.922s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:02 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Temporary image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 is fetched for user 52ec8a9b33e849659eec2b9893fb8db1. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:22:02 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d663c13-26ba-4734-a59c-854120e6a20f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_w2c5ib7ydevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:02 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.748s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:02 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:02 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Deleted volume successfully. Jun 19 04:22:02 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_w2c5ib7ydevstack@QuobyteHD Jun 19 04:22:02 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-747d2a12-e716-42fb-81b7-13fae803fb70 tempest-VolumesTransfersV357Test-472891486 None] Lock "cinder-223f0e6b-81f8-4ca5-a921-e6d424f4481b-delete_volume" released by "delete_volume" :: held 3.393s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:02 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ef5fa147-592d-4f6b-826d-cb338d554622" returned: 0 in 0.853s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Lock "cinder-quobyte-ef5fa147-592d-4f6b-826d-cb338d554622" released by "delete_volume" :: held 1.944s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Created reservations ['5a92995f-07bd-4cb0-9a31-e3fcf657da37', '54391205-beea-4670-ac74-7d445fcbce2f', '4f978dc4-70d3-4f33-8ed5-3fc06cdb824f', '3095310f-1293-4495-8e63-8d0fcb002ec2'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:03 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:22:03 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:03 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_w2c5ib7ydevstack@QuobyteHD" returned: 0 in 1.020s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2070045382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ad9b822-580e-445c-84a4-f9da0be3c723,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f519020c3675468f8a5bf34063561fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:00Z,use_quota=True,user_id='52ec8a9b33e849659eec2b9893fb8db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Creating volume 1ad9b822-580e-445c-84a4-f9da0be3c723 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:03 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:22:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:03 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 1073741824 Jun 19 04:22:03 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:04 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.967s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:04 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:04 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Deleted volume successfully. Jun 19 04:22:04 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-596db0c7-cb52-497f-98ba-f35508d5eab3 tempest-VolumesListTestJSON-1256609378 None] Lock "cinder-ef5fa147-592d-4f6b-826d-cb338d554622-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:04 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "cinder-67a43d95-b0f5-469e-908f-89e975926794-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:04 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Lock "cinder-67a43d95-b0f5-469e-908f-89e975926794-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:04 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "cinder-quobyte-67a43d95-b0f5-469e-908f-89e975926794" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:04 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Lock "cinder-quobyte-67a43d95-b0f5-469e-908f-89e975926794" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:04 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ca981a-0295-4a21-bb2e-89df87f79208]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-67a43d95-b0f5-469e-908f-89e975926794 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:04 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-67a43d95-b0f5-469e-908f-89e975926794 Jun 19 04:22:04 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:04 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 1073741824" returned: 0 in 1.209s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:04 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 Jun 19 04:22:04 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:05 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-67a43d95-b0f5-469e-908f-89e975926794" returned: 0 in 0.984s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-67a43d95-b0f5-469e-908f-89e975926794 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:05 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-67a43d95-b0f5-469e-908f-89e975926794 Jun 19 04:22:05 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:05 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723" returned: 0 in 0.891s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:05 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Attempting download of 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}])) to volume 1ad9b822-580e-445c-84a4-f9da0be3c723. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:22:05 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[21bdfa51-eba4-452d-9c12-c334ff07f9b8]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_7q_tb4i7 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:06 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_7q_tb4i7 Jun 19 04:22:06 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:06 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-67a43d95-b0f5-469e-908f-89e975926794" returned: 0 in 0.931s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Lock "cinder-quobyte-67a43d95-b0f5-469e-908f-89e975926794" released by "delete_volume" :: held 1.981s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:06 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Created reservations ['927dceb2-ecef-42d5-9a30-e1f52804ef5b', 'e9ecd101-a4ad-461f-a688-b1fb5da755b8', '1e0a06ae-76fa-449a-a47f-d346eac5c600', '3d686891-ebe2-4f42-97a1-ddee96149b4e'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:06 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:22:06 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:06 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_7q_tb4i7" returned: 0 in 1.074s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_7q_tb4i7 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:07 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_7q_tb4i7 Jun 19 04:22:07 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:07 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.946s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:07 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:07 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Deleted volume successfully. Jun 19 04:22:07 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4747eca2-7bb8-42e3-943c-3b90ed59f7ba tempest-VolumesListTestJSON-1256609378 None] Lock "cinder-67a43d95-b0f5-469e-908f-89e975926794-delete_volume" released by "delete_volume" :: held 3.333s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "cinder-14f8f2d5-52d9-4b14-b94b-374452414099-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Lock "cinder-14f8f2d5-52d9-4b14-b94b-374452414099-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:08 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_7q_tb4i7" returned: 1 in 1.230s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_7q_tb4i7' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:22:08 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[e430086f-d002-44e3-a37c-db4e8a40d819]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_w2c5ib7ydevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "cinder-quobyte-14f8f2d5-52d9-4b14-b94b-374452414099" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Lock "cinder-quobyte-14f8f2d5-52d9-4b14-b94b-374452414099" acquired by "delete_volume" :: waited 0.026s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:08 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c51e351-80bc-4f7c-a34a-8c40ea1d0fe2]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-14f8f2d5-52d9-4b14-b94b-374452414099 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:08 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_w2c5ib7ydevstack@QuobyteHD Jun 19 04:22:08 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:08 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-14f8f2d5-52d9-4b14-b94b-374452414099 Jun 19 04:22:08 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:09 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_w2c5ib7ydevstack@QuobyteHD" returned: 0 in 1.070s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:09 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 was qcow2, converting to raw {{(pid=93530) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:22:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_w2c5ib7ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:09 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_w2c5ib7ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 Jun 19 04:22:09 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:09 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-14f8f2d5-52d9-4b14-b94b-374452414099" returned: 0 in 1.065s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-14f8f2d5-52d9-4b14-b94b-374452414099 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:09 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-14f8f2d5-52d9-4b14-b94b-374452414099 Jun 19 04:22:09 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:10 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-14f8f2d5-52d9-4b14-b94b-374452414099" returned: 0 in 0.968s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Lock "cinder-quobyte-14f8f2d5-52d9-4b14-b94b-374452414099" released by "delete_volume" :: held 2.099s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:10 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Created reservations ['c01a01b3-76ce-4750-b679-efae083a3c2c', 'c2157ab8-1cde-4f2d-b632-06079b4274fe', '6a73fb93-6ef7-411a-b6b2-8abb44b5ca5f', '285194eb-28f6-48e1-990f-847cc3b7662e'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:10 devstack sudo[103481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:22:10 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:11 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.096s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:11 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:11 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Deleted volume successfully. Jun 19 04:22:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-584987cf-d904-413b-9663-cac9588b8cdf tempest-VolumesListTestJSON-1256609378 None] Lock "cinder-14f8f2d5-52d9-4b14-b94b-374452414099-delete_volume" released by "delete_volume" :: held 3.668s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:11 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_w2c5ib7ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723" returned: 0 in 2.759s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:11 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_w2c5ib7ydevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:22:11 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Converted 112.00 MB image at 40.58 MB/s Jun 19 04:22:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:12 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 1G Jun 19 04:22:12 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:12 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 1G" returned: 0 in 0.971s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:13 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab5962c-2a79-424b-852f-4e28a8c2581b]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:13 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 Jun 19 04:22:13 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:14 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723" returned: 0 in 1.046s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:14 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 Jun 19 04:22:14 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:14 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723" returned: 1 in 0.889s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:22:14 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Downloaded image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}])) to volume 1ad9b822-580e-445c-84a4-f9da0be3c723 successfully. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:22:14 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Temporary image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 for user 52ec8a9b33e849659eec2b9893fb8db1 is deleted. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:22:14 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Marking volume 1ad9b822-580e-445c-84a4-f9da0be3c723 as bootable. {{(pid=93530) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Copying metadata from image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 to 1ad9b822-580e-445c-84a4-f9da0be3c723. {{(pid=93530) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Creating volume glance metadata for volume 1ad9b822-580e-445c-84a4-f9da0be3c723 backed by image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93530) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26d126f6-6fb6-4481-a8de-b1b77dc990a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ad9b822-580e-445c-84a4-f9da0be3c723', 'volume_size': 1, 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41c991745fb845ed91d69be55aec3c73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d031f8-888b-41ad-b8aa-c78e14a651a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:15 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Volume volume-1ad9b822-580e-445c-84a4-f9da0be3c723 (1ad9b822-580e-445c-84a4-f9da0be3c723): created successfully Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d031f8-888b-41ad-b8aa-c78e14a651a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Flow 'volume_create_manager' (eee73ad5-7405-43c7-92fb-df50caaf74c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f3f667dc-fdfe-4907-8df6-c602c676e69f tempest-VolumesGetTest-1052626978 None] Created volume successfully. Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Flow 'volume_create_manager' (d6939775-0fe1-41c8-841d-722ffae675a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f64792-b9d7-438c-bf1e-8490f59109bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f64792-b9d7-438c-bf1e-8490f59109bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1436890839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b36898d-8cf7-42bc-99da-c8e36719fb73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c325921c5714a4381c9a15e9f88a078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:15Z,use_quota=True,user_id='63a70273c41d484c87a727c8ea2e1f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cbed2c6-cd43-4c69-ad18-88f5f2124089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cbed2c6-cd43-4c69-ad18-88f5f2124089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cb42bb-7d0f-46a9-a817-9ec2f5b80e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cb42bb-7d0f-46a9-a817-9ec2f5b80e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b36898d-8cf7-42bc-99da-c8e36719fb73', 'volume_name': 'volume-1b36898d-8cf7-42bc-99da-c8e36719fb73', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002fb105-6953-4f9a-8e77-7770e3717930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002fb105-6953-4f9a-8e77-7770e3717930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486b3eb1-b0b0-4172-b385-d1e83b6b76a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:15 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Volume 1b36898d-8cf7-42bc-99da-c8e36719fb73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b36898d-8cf7-42bc-99da-c8e36719fb73', 'volume_size': 1} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1436890839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b36898d-8cf7-42bc-99da-c8e36719fb73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c325921c5714a4381c9a15e9f88a078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:15Z,use_quota=True,user_id='63a70273c41d484c87a727c8ea2e1f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Creating volume 1b36898d-8cf7-42bc-99da-c8e36719fb73 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:15 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:15 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 1073741824 Jun 19 04:22:15 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Flow 'volume_create_manager' (af0e6f1e-60e5-47f9-b5e6-3fdb9e7739c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baeed9f3-dc09-49ae-ae6c-5805775029a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baeed9f3-dc09-49ae-ae6c-5805775029a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1748010911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2947ce-45e3-4846-be8b-03bc57d3373c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90396f1c4477489c8dd3a5553f06abcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:16Z,use_quota=True,user_id='b5218ab26dd146f1bb4b272324ea479e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daee946e-9508-45ae-9c07-dbe23fd2fc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daee946e-9508-45ae-9c07-dbe23fd2fc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94a1b37-9b2c-46a7-b09a-27c61d03af24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94a1b37-9b2c-46a7-b09a-27c61d03af24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c2947ce-45e3-4846-be8b-03bc57d3373c', 'volume_name': 'volume-7c2947ce-45e3-4846-be8b-03bc57d3373c', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2cf359-2d03-42cf-8987-601d7ad5569b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f2cf359-2d03-42cf-8987-601d7ad5569b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fd4ba3-ac90-4c09-b5b1-c16ba7ad6846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:15 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Volume 7c2947ce-45e3-4846-be8b-03bc57d3373c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c2947ce-45e3-4846-be8b-03bc57d3373c', 'volume_size': 1} Jun 19 04:22:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:16 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Flow 'volume_create_manager' (bd322953-736e-454d-a4c5-1b2723003811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff4e517-c663-441b-a930-e3857d1eeaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff4e517-c663-441b-a930-e3857d1eeaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1887566785',display_name='tempest-VolumesGetTest-Volume-1905575682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9a4993-2396-4ab5-accf-6e33b1e1dbaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f519020c3675468f8a5bf34063561fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:16Z,use_quota=True,user_id='52ec8a9b33e849659eec2b9893fb8db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11d0968-c0fd-445a-993d-672dd794290b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11d0968-c0fd-445a-993d-672dd794290b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7ae925-bf5b-44e6-8af0-618de961a1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7ae925-bf5b-44e6-8af0-618de961a1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d9a4993-2396-4ab5-accf-6e33b1e1dbaf', 'volume_name': 'volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb8ee49-12db-4974-b989-069032ce5ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb8ee49-12db-4974-b989-069032ce5ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e5457c-9295-46e2-a29a-8747cc77ad1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:16 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Volume 2d9a4993-2396-4ab5-accf-6e33b1e1dbaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf', 'volume_size': 1} Jun 19 04:22:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:16 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 1073741824" returned: 0 in 1.047s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:16 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 Jun 19 04:22:16 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:17 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73" returned: 0 in 0.661s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.619s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1748010911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2947ce-45e3-4846-be8b-03bc57d3373c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90396f1c4477489c8dd3a5553f06abcb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:16Z,use_quota=True,user_id='b5218ab26dd146f1bb4b272324ea479e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Creating volume 7c2947ce-45e3-4846-be8b-03bc57d3373c {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:17 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (486b3eb1-b0b0-4172-b385-d1e83b6b76a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b36898d-8cf7-42bc-99da-c8e36719fb73', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:17 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c 1073741824 Jun 19 04:22:17 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1ef8a4-b000-4e21-958e-7ee95e213582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:17 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Volume volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 (1b36898d-8cf7-42bc-99da-c8e36719fb73): created successfully Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1ef8a4-b000-4e21-958e-7ee95e213582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Flow 'volume_create_manager' (d6939775-0fe1-41c8-841d-722ffae675a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:17 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-fdda1956-8a1f-4379-afa5-8500f500b2ab tempest-VolumesCloneTest-187273474 None] Created volume successfully. Jun 19 04:22:18 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c 1073741824" returned: 0 in 0.878s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:18 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c Jun 19 04:22:18 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:19 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c" returned: 0 in 0.690s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.510s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1887566785',display_name='tempest-VolumesGetTest-Volume-1905575682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9a4993-2396-4ab5-accf-6e33b1e1dbaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f519020c3675468f8a5bf34063561fd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:16Z,use_quota=True,user_id='52ec8a9b33e849659eec2b9893fb8db1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Creating volume 2d9a4993-2396-4ab5-accf-6e33b1e1dbaf {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:19 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:19 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf 1073741824 Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fd4ba3-ac90-4c09-b5b1-c16ba7ad6846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c2947ce-45e3-4846-be8b-03bc57d3373c', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:19 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d56754-0a37-4aa8-8fe5-6d88a2b19885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:19 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Volume volume-7c2947ce-45e3-4846-be8b-03bc57d3373c (7c2947ce-45e3-4846-be8b-03bc57d3373c): created successfully Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d56754-0a37-4aa8-8fe5-6d88a2b19885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Flow 'volume_create_manager' (af0e6f1e-60e5-47f9-b5e6-3fdb9e7739c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:19 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-116a031f-2627-4797-ba7a-e31f82979c26 tempest-VolumesSnapshotListTestJSON-675772530 None] Created volume successfully. Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Flow 'volume_create_manager' (8d5d27d9-55b8-4353-8ba1-e40b347bb816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374412c1-26c1-4521-adfc-e66533c7f3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374412c1-26c1-4521-adfc-e66533c7f3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1757027969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf31a59e-7c8a-4453-83ba-892db9143e04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c325921c5714a4381c9a15e9f88a078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1b36898d-8cf7-42bc-99da-c8e36719fb73,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:19Z,use_quota=True,user_id='63a70273c41d484c87a727c8ea2e1f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cbd14c-5f4c-48c1-8aee-add79f732fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62cbd14c-5f4c-48c1-8aee-add79f732fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca75dd55-92c6-4e59-a046-abefb9f5d11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca75dd55-92c6-4e59-a046-abefb9f5d11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bf31a59e-7c8a-4453-83ba-892db9143e04', 'volume_name': 'volume-bf31a59e-7c8a-4453-83ba-892db9143e04', 'volume_size': 2, 'source_volid': '1b36898d-8cf7-42bc-99da-c8e36719fb73', 'source_volstatus': 'available'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19485bc-24bd-4787-92c3-c5472792318b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e19485bc-24bd-4787-92c3-c5472792318b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7596a8f-572b-4632-a769-2847528c1cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:19 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Volume bf31a59e-7c8a-4453-83ba-892db9143e04: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bf31a59e-7c8a-4453-83ba-892db9143e04', 'volume_size': 2, 'source_volid': '1b36898d-8cf7-42bc-99da-c8e36719fb73', 'source_volstatus': 'available'} Jun 19 04:22:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:20 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf 1073741824" returned: 0 in 1.170s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:20 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf Jun 19 04:22:20 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:21 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf" returned: 0 in 0.788s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.743s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:21 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Cloning volume 1b36898d-8cf7-42bc-99da-c8e36719fb73 to volume bf31a59e-7c8a-4453-83ba-892db9143e04 Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e5457c-9295-46e2-a29a-8747cc77ad1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45582dd-7ac3-45ea-9582-cde7e48dcbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:21 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Volume volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf (2d9a4993-2396-4ab5-accf-6e33b1e1dbaf): created successfully Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d45582dd-7ac3-45ea-9582-cde7e48dcbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Flow 'volume_create_manager' (bd322953-736e-454d-a4c5-1b2723003811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Creating offline snapshot 928af426-d6cf-4ac1-a420-43332a963c33 of volume 1b36898d-8cf7-42bc-99da-c8e36719fb73 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:22:21 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e48874be-8c5d-4bd5-8a95-8712c4c1f710 tempest-VolumesGetTest-1052626978 None] Created volume successfully. Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c1cb6e-784b-4bf1-9f6c-1ff510b670da]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:21 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 Jun 19 04:22:21 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Lock "cinder-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-quobyte-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf" acquired by "delete_volume" :: waited 0.032s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cbe89e-4f58-4fec-8637-01fa7599bbf0]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:22 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf Jun 19 04:22:22 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:22 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73" returned: 0 in 0.886s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:22 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 1G Jun 19 04:22:22 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:22 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf" returned: 0 in 0.769s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:22 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf Jun 19 04:22:22 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:22 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 1G" returned: 0 in 0.842s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:22 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 Jun 19 04:22:22 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:23 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf" returned: 0 in 0.760s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf" released by "delete_volume" :: held 1.582s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:23 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Created reservations ['6a28a3cd-ffdd-43c6-92e7-456ebd5f8cb4', '6e5bfdd2-94eb-4a62-9c2c-fc1ec4618e35', '2caf444b-70be-424f-9821-bb63ac551143', '8e560777-4f70-48f9-b5a2-fe526349f406'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:23 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:22:23 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:23 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33" returned: 0 in 0.787s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:23 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 is being set with open permissions: ugo+rw Jun 19 04:22:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:23 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 Jun 19 04:22:23 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:24 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-1ad9b822-580e-445c-84a4-f9da0be3c723-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:24 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Lock "cinder-1ad9b822-580e-445c-84a4-f9da0be3c723-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:24 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Acquiring lock "cinder-quobyte-1ad9b822-580e-445c-84a4-f9da0be3c723" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:24 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-1ad9b822-580e-445c-84a4-f9da0be3c723" acquired by "delete_volume" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:24 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.700s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:24 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:24 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Deleted volume successfully. Jun 19 04:22:24 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-072a590b-f2d9-4f26-8748-641fe88356d4 tempest-VolumesGetTest-1052626978 None] Lock "cinder-2d9a4993-2396-4ab5-accf-6e33b1e1dbaf-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:24 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d9ce90-6801-4606-996f-1a86ae3993e8]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:24 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 Jun 19 04:22:24 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:24 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33" returned: 0 in 0.858s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:24 devstack sudo[103589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.info Jun 19 04:22:24 devstack sudo[103589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:25 devstack sudo[103589]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.info" returned: 0 in 0.641s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:25 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.info is being set with open permissions: ugo+rw Jun 19 04:22:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:25 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:25 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.info Jun 19 04:22:25 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723" returned: 0 in 0.889s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:25 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 Jun 19 04:22:25 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:25 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.info" returned: 0 in 0.708s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:25 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Acquiring lock "cinder-quobyte-bf31a59e-7c8a-4453-83ba-892db9143e04" by "_copy_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Lock "cinder-quobyte-bf31a59e-7c8a-4453-83ba-892db9143e04" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] snapshot: 928af426-d6cf-4ac1-a420-43332a963c33, volume: bf31a59e-7c8a-4453-83ba-892db9143e04, {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:26 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723" returned: 1 in 0.760s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a7ac02-557b-4546-963d-d97d17ee4cf5]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:26 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723 Jun 19 04:22:26 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:26 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 Jun 19 04:22:26 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:26 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1ad9b822-580e-445c-84a4-f9da0be3c723" returned: 0 in 0.689s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Lock "cinder-quobyte-1ad9b822-580e-445c-84a4-f9da0be3c723" released by "delete_volume" :: held 2.460s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:26 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Created reservations ['d74441da-3f12-4949-81f4-ac5b373095ac', 'd1c6a556-f40b-4780-9aab-edb1f1f5c655', '08e19804-e764-4d58-9290-bba50f3e1966', '9edb5250-18e7-4b18-a5c8-6f6f2ae9dff0'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:27 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33" returned: 0 in 1.102s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b36898d-8cf7-42bc-99da-c8e36719fb73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:22:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:22:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Creating direct copy from snapshot {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:22:27 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:22:27 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:27 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73e1f91-f6a3-4e31-b12e-8b25bd20f71f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:27 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 Jun 19 04:22:27 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:28 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.177s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:28 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:28 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Deleted volume successfully. Jun 19 04:22:28 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4465f537-7b22-4711-8b61-5f5dd37cde5f tempest-VolumesGetTest-1052626978 None] Lock "cinder-1ad9b822-580e-445c-84a4-f9da0be3c723-delete_volume" released by "delete_volume" :: held 4.111s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:28 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73" returned: 0 in 1.303s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:28 devstack cinder-volume[93530]: DEBUG cinder.utils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Path /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04 not found in is_blk_device check {{(pid=93530) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:22:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:28 devstack sudo[103701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04 Jun 19 04:22:28 devstack sudo[103701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:36 devstack sudo[103701]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04" returned: 0 in 8.340s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:36 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[213b0366-69c7-4093-ae62-2192c16228f6]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:37 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 Jun 19 04:22:37 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=98,cinder:UPDATE=137,cinder:INSERT=38,cinder:DELETE=11 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:22:37 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:38 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73" returned: 0 in 1.313s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:38 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Image conversion details: src /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73, size 1024.00 MB, duration 8.34 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:22:38 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Converted 1024.00 MB image at 122.74 MB/s Jun 19 04:22:38 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04 is being set with open permissions: ugo+rw Jun 19 04:22:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:38 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04 Jun 19 04:22:38 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:38 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=144,cinder:SELECT=98,cinder:INSERT=40,cinder:DELETE=13 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:22:38 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04" returned: 0 in 0.738s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Lock "cinder-quobyte-bf31a59e-7c8a-4453-83ba-892db9143e04" released by "_copy_volume_from_snapshot" :: held 12.924s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Acquiring lock "cinder-quobyte-928af426-d6cf-4ac1-a420-43332a963c33" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Lock "cinder-quobyte-928af426-d6cf-4ac1-a420-43332a963c33" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Deleting offline snapshot 928af426-d6cf-4ac1-a420-43332a963c33 of volume 1b36898d-8cf7-42bc-99da-c8e36719fb73 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:22:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] snapshot_file for this snap is: volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:22:39 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0443ab4-a35c-440c-bf70-8a62eb32c305]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:39 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 Jun 19 04:22:39 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:39 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33" returned: 0 in 0.937s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:39 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b36898d-8cf7-42bc-99da-c8e36719fb73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:22:39 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[227d8d5a-911f-4088-b17b-192755893e17]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:40 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 Jun 19 04:22:40 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:40 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73" returned: 0 in 0.810s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:40 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 Jun 19 04:22:40 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:41 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33" returned: 0 in 0.894s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:41 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33 Jun 19 04:22:41 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:42 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73.928af426-d6cf-4ac1-a420-43332a963c33" returned: 0 in 0.674s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Lock "cinder-quobyte-928af426-d6cf-4ac1-a420-43332a963c33" released by "_delete_snapshot" :: held 3.421s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.340s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 22.348s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:42 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] Creating offline snapshot f3e305b4-c8a4-473a-a57d-92b661e8f0d3 of volume 7c2947ce-45e3-4846-be8b-03bc57d3373c {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:22:42 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7596a8f-572b-4632-a769-2847528c1cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf31a59e-7c8a-4453-83ba-892db9143e04', 'volume_size': 2, 'source_volid': '1b36898d-8cf7-42bc-99da-c8e36719fb73', 'source_volstatus': 'available'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:42 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c8a46e-bd5a-473f-afff-a89746f2c6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:42 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdef577c-a6d0-4457-b3cb-663aa0cbee7e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:42 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Volume volume-bf31a59e-7c8a-4453-83ba-892db9143e04 (bf31a59e-7c8a-4453-83ba-892db9143e04): created successfully Jun 19 04:22:42 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c8a46e-bd5a-473f-afff-a89746f2c6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:42 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Flow 'volume_create_manager' (8d5d27d9-55b8-4353-8ba1-e40b347bb816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:42 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-1aee99d5-2671-4c63-8d8a-089fa4490aee tempest-VolumesCloneTest-187273474 None] Created volume successfully. Jun 19 04:22:42 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c Jun 19 04:22:42 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Acquiring lock "cinder-bf31a59e-7c8a-4453-83ba-892db9143e04-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Lock "cinder-bf31a59e-7c8a-4453-83ba-892db9143e04-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Acquiring lock "cinder-quobyte-bf31a59e-7c8a-4453-83ba-892db9143e04" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Lock "cinder-quobyte-bf31a59e-7c8a-4453-83ba-892db9143e04" acquired by "delete_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:43 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[be245e61-cf2e-473d-b82d-359d6fb6f41b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:43 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c" returned: 0 in 0.924s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:43 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 1G Jun 19 04:22:43 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:43 devstack sudo[103803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04 Jun 19 04:22:43 devstack sudo[103803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:44 devstack sudo[103803]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04" returned: 0 in 0.911s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:44 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04 Jun 19 04:22:44 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:44 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 1G" returned: 0 in 1.149s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2947ce-45e3-4846-be8b-03bc57d3373c -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:44 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2947ce-45e3-4846-be8b-03bc57d3373c -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 Jun 19 04:22:44 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:44 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-bf31a59e-7c8a-4453-83ba-892db9143e04" returned: 0 in 0.762s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Lock "cinder-quobyte-bf31a59e-7c8a-4453-83ba-892db9143e04" released by "delete_volume" :: held 1.740s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Created reservations ['174a18c3-f73a-48fd-b7f9-801827a34269', 'c3f25192-9ffe-49e9-b0f8-0b195214f623', 'c638eb66-f58e-4fc1-8a40-758d03cd41f2', '14714b5d-594a-47dd-b763-f50447b502fc'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:45 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:22:45 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:45 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2947ce-45e3-4846-be8b-03bc57d3373c -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3" returned: 0 in 0.791s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:45 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 is being set with open permissions: ugo+rw Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:45 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 Jun 19 04:22:45 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Acquiring lock "cinder-1b36898d-8cf7-42bc-99da-c8e36719fb73-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Lock "cinder-1b36898d-8cf7-42bc-99da-c8e36719fb73-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Acquiring lock "cinder-quobyte-1b36898d-8cf7-42bc-99da-c8e36719fb73" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Lock "cinder-quobyte-1b36898d-8cf7-42bc-99da-c8e36719fb73" acquired by "delete_volume" :: waited 0.029s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c432712-1801-4fcc-bd96-566933a43ea9]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:45 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 Jun 19 04:22:45 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:46 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.868s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:46 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:46 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Deleted volume successfully. Jun 19 04:22:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f7068d8e-3d4c-4d85-a35d-cdfb84713fb3 tempest-VolumesCloneTest-187273474 None] Lock "cinder-bf31a59e-7c8a-4453-83ba-892db9143e04-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:46 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3" returned: 0 in 1.043s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:46 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.info Jun 19 04:22:46 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:46 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73" returned: 0 in 0.993s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:46 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73 Jun 19 04:22:46 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:47 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.info" returned: 0 in 0.940s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:47 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.info is being set with open permissions: ugo+rw Jun 19 04:22:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:47 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.info Jun 19 04:22:47 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:47 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1b36898d-8cf7-42bc-99da-c8e36719fb73" returned: 0 in 0.727s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:47 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Lock "cinder-quobyte-1b36898d-8cf7-42bc-99da-c8e36719fb73" released by "delete_volume" :: held 1.817s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:47 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Created reservations ['80e668d5-9007-4cd4-91e1-b2bff9952c64', 'bad9a0d0-0255-43d8-ac71-c5f58800d47a', '401a59e3-c47a-42be-a7dc-26f7e101d93c', '5457e556-6d2c-4619-9e2f-e22fc0a43efa'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:47 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:22:47 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:47 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Flow 'volume_create_manager' (314f72a9-7f30-413b-a281-9cf3a4659d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ac94a9-8da1-4488-b160-cf0ef261c3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ac94a9-8da1-4488-b160-cf0ef261c3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1843226154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ba2853-339a-405f-a137-6508beb97dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c68afe099e49ccaf7a0cd31ef88e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:48Z,use_quota=True,user_id='ec6adceb18bc49e2b15acad9c769b686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e0b700-b84b-403a-9e44-c37a71a53b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e0b700-b84b-403a-9e44-c37a71a53b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b62014-5038-4ad3-a2b5-aeb8f9716364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8b62014-5038-4ad3-a2b5-aeb8f9716364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ba2853-339a-405f-a137-6508beb97dc4', 'volume_name': 'volume-f9ba2853-339a-405f-a137-6508beb97dc4', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf7ed1e-6aca-43c0-b97b-c3cdf09ee889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf7ed1e-6aca-43c0-b97b-c3cdf09ee889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8371e7f-76b0-41ca-adc9-b533ed4380f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:48 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Volume f9ba2853-339a-405f-a137-6508beb97dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ba2853-339a-405f-a137-6508beb97dc4', 'volume_size': 1} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:48 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.info" returned: 0 in 0.784s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.746s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.041s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1843226154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ba2853-339a-405f-a137-6508beb97dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c68afe099e49ccaf7a0cd31ef88e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:48Z,use_quota=True,user_id='ec6adceb18bc49e2b15acad9c769b686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Creating volume f9ba2853-339a-405f-a137-6508beb97dc4 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:48 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:48 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4 1073741824 Jun 19 04:22:48 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:48 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-17822dcf-e003-4640-bbb4-0e22873eb06d tempest-VolumesSnapshotListTestJSON-675772530 None] Create snapshot completed successfully Jun 19 04:22:48 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.082s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:48 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Deleted volume successfully. Jun 19 04:22:48 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-742755e1-1bad-4578-8eec-2eb469becb76 tempest-VolumesCloneTest-187273474 None] Lock "cinder-1b36898d-8cf7-42bc-99da-c8e36719fb73-delete_volume" released by "delete_volume" :: held 3.283s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:49 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4 1073741824" returned: 0 in 1.164s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:49 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4 Jun 19 04:22:49 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:50 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4" returned: 0 in 0.837s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.157s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] Creating offline snapshot 74d82377-3dd3-421d-b923-a733f77f84f1 of volume 7c2947ce-45e3-4846-be8b-03bc57d3373c {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:22:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8371e7f-76b0-41ca-adc9-b533ed4380f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ba2853-339a-405f-a137-6508beb97dc4', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9ae5c7-24e5-4985-a7a6-75ed52a6c6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:50 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de78ecc-3b70-4db4-990c-3bb2469ce785]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:50 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Volume volume-f9ba2853-339a-405f-a137-6508beb97dc4 (f9ba2853-339a-405f-a137-6508beb97dc4): created successfully Jun 19 04:22:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9ae5c7-24e5-4985-a7a6-75ed52a6c6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Flow 'volume_create_manager' (314f72a9-7f30-413b-a281-9cf3a4659d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:50 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-53f982da-8364-4c5c-8ea0-12656e5e1adb tempest-VolumesSnapshotTestJSON-1578547850 None] Created volume successfully. Jun 19 04:22:50 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 Jun 19 04:22:50 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:51 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3" returned: 0 in 0.806s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c2947ce-45e3-4846-be8b-03bc57d3373c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:51 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 1G Jun 19 04:22:51 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Flow 'volume_create_manager' (521da317-cd7c-4520-bda4-c094a889f14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc12ab79-d130-4e27-8477-c25572083ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc12ab79-d130-4e27-8477-c25572083ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1832198180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82646e2-cd15-4a1f-8982-98ae51914335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6e7ed100c349daa8feaa7e2c3af600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:51Z,use_quota=True,user_id='ac5ae4ff483d427384857ac156c72d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54853877-6256-4c96-a060-b3c6174c0b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54853877-6256-4c96-a060-b3c6174c0b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7541c0-5460-4b6d-87ab-e06709d0a1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7541c0-5460-4b6d-87ab-e06709d0a1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd82646e2-cd15-4a1f-8982-98ae51914335', 'volume_name': 'volume-d82646e2-cd15-4a1f-8982-98ae51914335', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19bc3bbc-ccdf-4962-9766-6275a964100b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19bc3bbc-ccdf-4962-9766-6275a964100b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66f741a-30a7-4300-b9b9-a4257991ff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:51 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Volume d82646e2-cd15-4a1f-8982-98ae51914335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d82646e2-cd15-4a1f-8982-98ae51914335', 'volume_size': 1} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Flow 'volume_create_manager' (c0f523dc-8eb1-444b-939f-69305f3bbc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db3aebb-a369-4524-8ad5-0801574c4481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db3aebb-a369-4524-8ad5-0801574c4481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1930674855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9d846d-1a06-412b-9729-6aa0cb13e913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5b65dc538945ada3495c6d15242c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:52Z,use_quota=True,user_id='56bf6ad1de3a43389b82594fc47cc01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3139fb43-8cdf-499a-9c3b-7f0f0428b013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3139fb43-8cdf-499a-9c3b-7f0f0428b013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9c5478-7adb-4fdd-a96e-4a36aa3265b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9c5478-7adb-4fdd-a96e-4a36aa3265b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac9d846d-1a06-412b-9729-6aa0cb13e913', 'volume_name': 'volume-ac9d846d-1a06-412b-9729-6aa0cb13e913', 'volume_size': 2}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2f9c3d-51b6-4325-8ae3-22ab6be1b752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2f9c3d-51b6-4325-8ae3-22ab6be1b752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03aae4c-83e2-47f2-91df-413036bce599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:51 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Volume ac9d846d-1a06-412b-9729-6aa0cb13e913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac9d846d-1a06-412b-9729-6aa0cb13e913', 'volume_size': 2} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:52 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 1G" returned: 0 in 1.014s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:52 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 Jun 19 04:22:52 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:52 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1" returned: 0 in 0.827s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:52 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 is being set with open permissions: ugo+rw Jun 19 04:22:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:52 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 Jun 19 04:22:52 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:53 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1" returned: 0 in 0.727s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.488s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.048s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1832198180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82646e2-cd15-4a1f-8982-98ae51914335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6e7ed100c349daa8feaa7e2c3af600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:51Z,use_quota=True,user_id='ac5ae4ff483d427384857ac156c72d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Creating volume d82646e2-cd15-4a1f-8982-98ae51914335 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:53 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:22:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:53 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335 1073741824 Jun 19 04:22:53 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:53 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-c71f7a1a-d314-436e-9075-a623d8b83bbc tempest-VolumesSnapshotListTestJSON-675772530 None] Create snapshot completed successfully Jun 19 04:22:54 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335 1073741824" returned: 0 in 0.865s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:54 devstack sudo[103886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335 Jun 19 04:22:54 devstack sudo[103886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:55 devstack sudo[103886]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335" returned: 0 in 0.720s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.544s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1930674855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac9d846d-1a06-412b-9729-6aa0cb13e913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b5b65dc538945ada3495c6d15242c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:52Z,use_quota=True,user_id='56bf6ad1de3a43389b82594fc47cc01e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Creating volume ac9d846d-1a06-412b-9729-6aa0cb13e913 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:55 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ac9d846d-1a06-412b-9729-6aa0cb13e913 2147483648 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66f741a-30a7-4300-b9b9-a4257991ff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d82646e2-cd15-4a1f-8982-98ae51914335', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e9889c-27d5-444d-85e9-e835a7ff4f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:55 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ac9d846d-1a06-412b-9729-6aa0cb13e913 2147483648 Jun 19 04:22:55 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:55 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Volume volume-d82646e2-cd15-4a1f-8982-98ae51914335 (d82646e2-cd15-4a1f-8982-98ae51914335): created successfully Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81e9889c-27d5-444d-85e9-e835a7ff4f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Flow 'volume_create_manager' (521da317-cd7c-4520-bda4-c094a889f14c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:55 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-3775a441-7000-4a1e-a5be-23350529c8c5 tempest-AttachVolumeNegativeTest-1559506757 None] Created volume successfully. Jun 19 04:22:56 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ac9d846d-1a06-412b-9729-6aa0cb13e913 2147483648" returned: 0 in 0.928s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ac9d846d-1a06-412b-9729-6aa0cb13e913 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:56 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ac9d846d-1a06-412b-9729-6aa0cb13e913 Jun 19 04:22:56 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:57 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ac9d846d-1a06-412b-9729-6aa0cb13e913" returned: 0 in 0.690s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.187s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] Creating offline snapshot 4cd327a3-304b-4b44-acc7-21803c83e187 of volume f9ba2853-339a-405f-a137-6508beb97dc4 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:22:57 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03aae4c-83e2-47f2-91df-413036bce599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac9d846d-1a06-412b-9729-6aa0cb13e913', 'volume_size': 2}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:57 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf966fd4-548a-4346-ba80-cb463b9057a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:57 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad87952-99c1-4aff-9e21-ab299390fda3]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:57 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Volume volume-ac9d846d-1a06-412b-9729-6aa0cb13e913 (ac9d846d-1a06-412b-9729-6aa0cb13e913): created successfully Jun 19 04:22:57 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf966fd4-548a-4346-ba80-cb463b9057a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:57 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Flow 'volume_create_manager' (c0f523dc-8eb1-444b-939f-69305f3bbc29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:57 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-2fd01c72-660c-4e93-970d-e762b50dc00a tempest-VolumesCloneNegativeTest-1118844842 None] Created volume successfully. Jun 19 04:22:57 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4 Jun 19 04:22:57 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:57 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4" returned: 0 in 0.779s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:57 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 1G Jun 19 04:22:57 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Acquiring lock "cinder-ac9d846d-1a06-412b-9729-6aa0cb13e913-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Lock "cinder-ac9d846d-1a06-412b-9729-6aa0cb13e913-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Acquiring lock "cinder-quobyte-ac9d846d-1a06-412b-9729-6aa0cb13e913" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Lock "cinder-quobyte-ac9d846d-1a06-412b-9729-6aa0cb13e913" acquired by "delete_volume" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b927ac-057e-407f-b19b-19f07f0a2acc]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ac9d846d-1a06-412b-9729-6aa0cb13e913 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:58 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ac9d846d-1a06-412b-9729-6aa0cb13e913 Jun 19 04:22:58 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:58 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 1G" returned: 0 in 0.949s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ba2853-339a-405f-a137-6508beb97dc4 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:58 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ba2853-339a-405f-a137-6508beb97dc4 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 Jun 19 04:22:58 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:58 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:22:58 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-00af3b21-2e63-4bd4-abea-96d4ac3398f8 req-3ec26ae8-485a-41ef-9301-19b6e717547f tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:59 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ac9d846d-1a06-412b-9729-6aa0cb13e913" returned: 0 in 0.888s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ac9d846d-1a06-412b-9729-6aa0cb13e913 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:59 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ac9d846d-1a06-412b-9729-6aa0cb13e913 Jun 19 04:22:59 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:59 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ba2853-339a-405f-a137-6508beb97dc4 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187" returned: 0 in 0.800s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:59 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 is being set with open permissions: ugo+rw Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:59 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:59 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 Jun 19 04:22:59 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.690s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:22:59 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ac9d846d-1a06-412b-9729-6aa0cb13e913" returned: 0 in 0.662s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Lock "cinder-quobyte-ac9d846d-1a06-412b-9729-6aa0cb13e913" released by "delete_volume" :: held 1.590s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Created reservations ['50fb8a5c-a023-44d6-9721-cb30fbf6560b', 'eb31ed12-d462-4d50-ab17-8b0853eec49c', '9780f34a-4130-4a2f-b05c-9e76e15e46fa', '4f50b61f-b452-46f6-90f0-1e4d39365f80'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:59 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:00 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:23:00 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:00 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187" returned: 0 in 0.701s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:00 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.info Jun 19 04:23:00 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:00 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.653s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:00 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:00 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Deleted volume successfully. Jun 19 04:23:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7f39e9c8-ee75-4114-83ac-0fd3f7e72934 tempest-VolumesCloneNegativeTest-1118844842 None] Lock "cinder-ac9d846d-1a06-412b-9729-6aa0cb13e913-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:01 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.info" returned: 0 in 0.732s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:01 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.info is being set with open permissions: ugo+rw Jun 19 04:23:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:01 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.info Jun 19 04:23:01 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:01 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.info" returned: 0 in 0.684s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.747s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.022s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] Creating offline snapshot 78971c8f-0da4-4a65-940a-45a908b499fb of volume 7c2947ce-45e3-4846-be8b-03bc57d3373c {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:23:01 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1be40a-1935-4696-93c3-099a7037dc58]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:01 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-55d0ccf4-110a-4a98-b61f-77a8dbc38c46 tempest-VolumesSnapshotTestJSON-1578547850 None] Create snapshot completed successfully Jun 19 04:23:01 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 Jun 19 04:23:01 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-4cd327a3-304b-4b44-acc7-21803c83e187-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-4cd327a3-304b-4b44-acc7-21803c83e187-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-f9ba2853-339a-405f-a137-6508beb97dc4" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-f9ba2853-339a-405f-a137-6508beb97dc4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-4cd327a3-304b-4b44-acc7-21803c83e187" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-4cd327a3-304b-4b44-acc7-21803c83e187" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Deleting offline snapshot 4cd327a3-304b-4b44-acc7-21803c83e187 of volume f9ba2853-339a-405f-a137-6508beb97dc4 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:23:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] snapshot_file for this snap is: volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:23:02 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fedad08-d204-438c-892d-c529b94806ae]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:02 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 Jun 19 04:23:02 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:02 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1" returned: 0 in 1.056s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c2947ce-45e3-4846-be8b-03bc57d3373c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:23:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:02 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb 1G Jun 19 04:23:02 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:03 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187" returned: 0 in 0.932s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9ba2853-339a-405f-a137-6508beb97dc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a996b2f-da67-4f64-9423-275bac6b53ef]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Flow 'volume_create_manager' (346cde45-8088-4887-aef2-ceb2f03afcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b14645-c002-4802-82a6-2a19ace14665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:03 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4 Jun 19 04:23:03 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b14645-c002-4802-82a6-2a19ace14665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1567838716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d4b8fd-3468-49c1-9f44-f2a55ff4a22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6054b8cef1248b2b8969130e2323842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:04Z,use_quota=True,user_id='83680a7c59aa4f4a9c0ee3ae32c21e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287ff2ce-6050-4914-a18f-85fffb7d3fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287ff2ce-6050-4914-a18f-85fffb7d3fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25262a5a-55e9-406d-8ed0-db321218e290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25262a5a-55e9-406d-8ed0-db321218e290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82d4b8fd-3468-49c1-9f44-f2a55ff4a22f', 'volume_name': 'volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5a7d85-6f75-46ef-b6ea-5c559315d2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5a7d85-6f75-46ef-b6ea-5c559315d2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f40f3c-ea73-4c32-9812-83b80b6c8c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:03 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Volume 82d4b8fd-3468-49c1-9f44-f2a55ff4a22f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f', 'volume_size': 1} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:03 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb 1G" returned: 0 in 0.994s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:03 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb Jun 19 04:23:03 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:04 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4" returned: 0 in 0.860s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:04 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 Jun 19 04:23:04 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:04 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb" returned: 0 in 0.712s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:04 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb is being set with open permissions: ugo+rw Jun 19 04:23:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:04 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb Jun 19 04:23:04 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:05 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187" returned: 0 in 0.730s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:05 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187 Jun 19 04:23:05 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:05 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb" returned: 0 in 0.729s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.610s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-00af3b21-2e63-4bd4-abea-96d4ac3398f8 req-3ec26ae8-485a-41ef-9301-19b6e717547f tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.259s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:05 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0054445-4da4-4d26-b9d8-173914c4accc]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-00af3b21-2e63-4bd4-abea-96d4ac3398f8 req-3ec26ae8-485a-41ef-9301-19b6e717547f tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:05 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-9703be4d-a1f6-4a1c-9d5a-6652e9ebada3 tempest-VolumesSnapshotListTestJSON-675772530 None] Create snapshot completed successfully Jun 19 04:23:05 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335 Jun 19 04:23:05 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:06 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4.4cd327a3-304b-4b44-acc7-21803c83e187" returned: 0 in 0.702s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-4cd327a3-304b-4b44-acc7-21803c83e187" released by "_delete_snapshot" :: held 3.391s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-f9ba2853-339a-405f-a137-6508beb97dc4" released by "delete_snapshot" :: held 3.418s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Created reservations ['e16f030d-7051-4041-a998-4dd67e0a3807', 'e2e3ed0b-3e13-442a-87ac-13cd8750667e', '8cb696b4-82ab-4eac-b500-6c761856fbbe', 'c2fd4d4a-9d0d-401c-b6b2-953d337b4ff1'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:06 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-00af3b21-2e63-4bd4-abea-96d4ac3398f8 req-3ec26ae8-485a-41ef-9301-19b6e717547f tempest-AttachVolumeNegativeTest-1559506757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335" returned: 0 in 0.833s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-00af3b21-2e63-4bd4-abea-96d4ac3398f8 req-3ec26ae8-485a-41ef-9301-19b6e717547f tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.851s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.369s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1567838716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82d4b8fd-3468-49c1-9f44-f2a55ff4a22f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6054b8cef1248b2b8969130e2323842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:04Z,use_quota=True,user_id='83680a7c59aa4f4a9c0ee3ae32c21e69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Creating volume 82d4b8fd-3468-49c1-9f44-f2a55ff4a22f {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:06 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:06 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f 1073741824 Jun 19 04:23:06 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-00af3b21-2e63-4bd4-abea-96d4ac3398f8 req-3ec26ae8-485a-41ef-9301-19b6e717547f tempest-AttachVolumeNegativeTest-1559506757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-d82646e2-cd15-4a1f-8982-98ae51914335', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53e7a78c-9fe6-41f5-b8fb-6854f6ec3914', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:23:06 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Delete snapshot completed successfully. Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3635d21b-b74a-4525-abaf-0d5858d823b2 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-4cd327a3-304b-4b44-acc7-21803c83e187-delete_snapshot" released by "delete_snapshot" :: held 3.786s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:06 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-00af3b21-2e63-4bd4-abea-96d4ac3398f8 req-3ec26ae8-485a-41ef-9301-19b6e717547f tempest-AttachVolumeNegativeTest-1559506757 None] attachment_update completed successfully. Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "cinder-78971c8f-0da4-4a65-940a-45a908b499fb-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-78971c8f-0da4-4a65-940a-45a908b499fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "cinder-quobyte-7c2947ce-45e3-4846-be8b-03bc57d3373c" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-quobyte-7c2947ce-45e3-4846-be8b-03bc57d3373c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "cinder-quobyte-78971c8f-0da4-4a65-940a-45a908b499fb" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-quobyte-78971c8f-0da4-4a65-940a-45a908b499fb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Deleting offline snapshot 78971c8f-0da4-4a65-940a-45a908b499fb of volume 7c2947ce-45e3-4846-be8b-03bc57d3373c {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] snapshot_file for this snap is: volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceb0b93-9805-45ea-8009-94d01932f0f7]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:06 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb Jun 19 04:23:06 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:07 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f 1073741824" returned: 0 in 0.979s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:07 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f Jun 19 04:23:07 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Flow 'volume_create_manager' (0f05a536-dbc6-4d68-8d10-efaf54929a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b90ed40-ee7e-4a06-84ec-8d910dac7aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b90ed40-ee7e-4a06-84ec-8d910dac7aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1026809192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b53369-a34a-45ce-96c5-ce53d5bf320d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c68afe099e49ccaf7a0cd31ef88e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:07Z,use_quota=True,user_id='ec6adceb18bc49e2b15acad9c769b686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87295665-be16-4148-9d45-d997d01ee0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87295665-be16-4148-9d45-d997d01ee0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad46c504-6f11-4877-9aa9-875fac9b3a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad46c504-6f11-4877-9aa9-875fac9b3a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8b53369-a34a-45ce-96c5-ce53d5bf320d', 'volume_name': 'volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9b4bd5-7f73-405e-8ec8-47592228cc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9b4bd5-7f73-405e-8ec8-47592228cc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afecaeb-c067-4f3a-9554-2102874a1355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:07 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Volume d8b53369-a34a-45ce-96c5-ce53d5bf320d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d', 'volume_size': 1} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:07 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb" returned: 0 in 0.889s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c2947ce-45e3-4846-be8b-03bc57d3373c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d6df64-1aef-40e9-ba66-ae8d7e797c58]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:07 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 Jun 19 04:23:07 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:08 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f" returned: 0 in 0.735s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.376s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1026809192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b53369-a34a-45ce-96c5-ce53d5bf320d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c68afe099e49ccaf7a0cd31ef88e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:07Z,use_quota=True,user_id='ec6adceb18bc49e2b15acad9c769b686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Creating volume d8b53369-a34a-45ce-96c5-ce53d5bf320d {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:08 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f40f3c-ea73-4c32-9812-83b80b6c8c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:08 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d 1073741824 Jun 19 04:23:08 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35661d49-8101-4056-871a-6ac2e3c4f854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:08 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Volume volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f (82d4b8fd-3468-49c1-9f44-f2a55ff4a22f): created successfully Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35661d49-8101-4056-871a-6ac2e3c4f854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Flow 'volume_create_manager' (346cde45-8088-4887-aef2-ceb2f03afcaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:08 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-cf35414c-71d3-4a37-9de9-0528a568ae1b tempest-VolumesNegativeTest-1232941544 None] Created volume successfully. Jun 19 04:23:08 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1" returned: 0 in 0.785s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c2947ce-45e3-4846-be8b-03bc57d3373c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:08 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb Jun 19 04:23:08 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:08 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d 1073741824" returned: 0 in 0.828s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:08 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d Jun 19 04:23:08 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:09 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb" returned: 0 in 0.932s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:09 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb Jun 19 04:23:09 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:09 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d" returned: 0 in 0.720s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:23:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6afecaeb-c067-4f3a-9554-2102874a1355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61dee2ad-8259-40bd-a0dc-14d1deab0834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:09 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Volume volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d (d8b53369-a34a-45ce-96c5-ce53d5bf320d): created successfully Jun 19 04:23:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61dee2ad-8259-40bd-a0dc-14d1deab0834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Flow 'volume_create_manager' (0f05a536-dbc6-4d68-8d10-efaf54929a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:09 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-5a932a9e-263f-4341-a06f-cab29d25db65 tempest-VolumesSnapshotTestJSON-1578547850 None] Created volume successfully. Jun 19 04:23:10 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.78971c8f-0da4-4a65-940a-45a908b499fb" returned: 0 in 0.689s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-quobyte-78971c8f-0da4-4a65-940a-45a908b499fb" released by "_delete_snapshot" :: held 3.396s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-quobyte-7c2947ce-45e3-4846-be8b-03bc57d3373c" released by "delete_snapshot" :: held 3.421s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Created reservations ['66d4c40c-6213-4eda-9394-c4641352d0b8', '08b317ad-9dcd-484c-bee9-3f3b4e297996', '50a737c6-49ce-4114-a242-9c30b0e5fe1d', 'e7a225c7-be0f-4cfd-ac81-ae55097edc18'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:10 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Delete snapshot completed successfully. Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bf80bf80-3c41-4587-849d-f9b11cb44a90 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-78971c8f-0da4-4a65-940a-45a908b499fb-delete_snapshot" released by "delete_snapshot" :: held 3.567s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] Creating offline snapshot a42b01cd-fa3d-474b-bd70-aaa856039877 of volume d8b53369-a34a-45ce-96c5-ce53d5bf320d {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e99f521-4fe5-4a8f-9e75-1b7d9281542e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "cinder-74d82377-3dd3-421d-b923-a733f77f84f1-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-74d82377-3dd3-421d-b923-a733f77f84f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "cinder-quobyte-7c2947ce-45e3-4846-be8b-03bc57d3373c" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:10 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d Jun 19 04:23:10 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-quobyte-7c2947ce-45e3-4846-be8b-03bc57d3373c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "cinder-quobyte-74d82377-3dd3-421d-b923-a733f77f84f1" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-quobyte-74d82377-3dd3-421d-b923-a733f77f84f1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Deleting offline snapshot 74d82377-3dd3-421d-b923-a733f77f84f1 of volume 7c2947ce-45e3-4846-be8b-03bc57d3373c {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:23:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] snapshot_file for this snap is: volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:23:11 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b338b47-0ad7-4beb-9cd7-24fe62544d81]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:11 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 Jun 19 04:23:11 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:11 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d" returned: 0 in 0.825s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:11 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 1G Jun 19 04:23:11 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:11 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1" returned: 0 in 0.903s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c2947ce-45e3-4846-be8b-03bc57d3373c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:23:12 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ec6e26-7118-4624-9b27-ab5fcc62f62c]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:12 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 Jun 19 04:23:12 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:12 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 1G" returned: 0 in 1.088s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:12 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 Jun 19 04:23:12 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:12 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3" returned: 0 in 0.923s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:12 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c2947ce-45e3-4846-be8b-03bc57d3373c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:23:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:12 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 Jun 19 04:23:12 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:13 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877" returned: 0 in 0.881s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:13 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 is being set with open permissions: ugo+rw Jun 19 04:23:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:13 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 Jun 19 04:23:13 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:13 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1" returned: 0 in 0.982s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:13 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1 Jun 19 04:23:13 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:14 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877" returned: 0 in 0.769s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:14 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.info Jun 19 04:23:14 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:14 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.74d82377-3dd3-421d-b923-a733f77f84f1" returned: 0 in 0.768s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-quobyte-74d82377-3dd3-421d-b923-a733f77f84f1" released by "_delete_snapshot" :: held 3.759s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-quobyte-7c2947ce-45e3-4846-be8b-03bc57d3373c" released by "delete_snapshot" :: held 3.789s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:14 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Created reservations ['5c31fe99-2080-4020-afbe-fd0a7345f8b5', '8e63a5b7-2d1f-43d7-aba5-429db1468aab', 'b54a1159-a920-4b5d-a89e-ac9500600b84', '296e2903-5f33-4d22-99dd-7d674dc16c1d'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Delete snapshot completed successfully. Jun 19 04:23:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6036b251-9b36-49e3-93cb-6d62bbf3c54b tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-74d82377-3dd3-421d-b923-a733f77f84f1-delete_snapshot" released by "delete_snapshot" :: held 4.098s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "cinder-f3e305b4-c8a4-473a-a57d-92b661e8f0d3-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-f3e305b4-c8a4-473a-a57d-92b661e8f0d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "cinder-quobyte-7c2947ce-45e3-4846-be8b-03bc57d3373c" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-quobyte-7c2947ce-45e3-4846-be8b-03bc57d3373c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "cinder-quobyte-f3e305b4-c8a4-473a-a57d-92b661e8f0d3" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-quobyte-f3e305b4-c8a4-473a-a57d-92b661e8f0d3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Deleting offline snapshot f3e305b4-c8a4-473a-a57d-92b661e8f0d3 of volume 7c2947ce-45e3-4846-be8b-03bc57d3373c {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:23:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] snapshot_file for this snap is: volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:23:15 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4518f0-e401-4bc7-ae77-1ef78b55047f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:15 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.info" returned: 0 in 1.012s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:15 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.info is being set with open permissions: ugo+rw Jun 19 04:23:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:15 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 Jun 19 04:23:15 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:15 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.info Jun 19 04:23:15 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:16 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.info" returned: 0 in 0.948s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.644s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:16 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-380d4b5a-6faf-4c95-85cf-3d19d4d749b3 tempest-VolumesSnapshotTestJSON-1578547850 None] Create snapshot completed successfully Jun 19 04:23:16 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3" returned: 0 in 1.254s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c2947ce-45e3-4846-be8b-03bc57d3373c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:23:16 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[337cf3a3-e5cd-45b6-a475-d95e3660030b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:16 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c Jun 19 04:23:16 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:17 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c" returned: 0 in 0.980s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:17 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 Jun 19 04:23:17 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:17 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Flow 'volume_create_manager' (0318f089-dd2b-4577-a794-cc58b361b578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8debe210-d7ea-4c7d-8db8-f8926f3a9606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8debe210-d7ea-4c7d-8db8-f8926f3a9606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-153527791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49635c28-327c-40d2-8c47-d9565bb15d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c68afe099e49ccaf7a0cd31ef88e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=a42b01cd-fa3d-474b-bd70-aaa856039877,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:18Z,use_quota=True,user_id='ec6adceb18bc49e2b15acad9c769b686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d528603b-392b-4946-8612-937e7941594d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d528603b-392b-4946-8612-937e7941594d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d383ca99-0660-42f9-84c7-aa9111665d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d383ca99-0660-42f9-84c7-aa9111665d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '49635c28-327c-40d2-8c47-d9565bb15d37', 'volume_name': 'volume-49635c28-327c-40d2-8c47-d9565bb15d37', 'volume_size': 2, 'snapshot_id': 'a42b01cd-fa3d-474b-bd70-aaa856039877'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e70b58-1bd0-4ad8-bc40-31b81399179d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e70b58-1bd0-4ad8-bc40-31b81399179d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f552245-1533-4274-84da-739b84c37628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:18 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Volume 49635c28-327c-40d2-8c47-d9565bb15d37: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-49635c28-327c-40d2-8c47-d9565bb15d37', 'volume_size': 2, 'snapshot_id': 'a42b01cd-fa3d-474b-bd70-aaa856039877'} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-a42b01cd-fa3d-474b-bd70-aaa856039877-49635c28-327c-40d2-8c47-d9565bb15d37" by "_create_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-a42b01cd-fa3d-474b-bd70-aaa856039877-49635c28-327c-40d2-8c47-d9565bb15d37" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Creating volume 49635c28-327c-40d2-8c47-d9565bb15d37 from snapshot a42b01cd-fa3d-474b-bd70-aaa856039877 {{(pid=93530) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-49635c28-327c-40d2-8c47-d9565bb15d37" by "_copy_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-49635c28-327c-40d2-8c47-d9565bb15d37" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] snapshot: a42b01cd-fa3d-474b-bd70-aaa856039877, volume: 49635c28-327c-40d2-8c47-d9565bb15d37, {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d002430-2d8c-4dce-b3a2-967ef16438b5]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:18 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 Jun 19 04:23:18 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:18 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3" returned: 0 in 0.869s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:18 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3 Jun 19 04:23:18 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:19 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877" returned: 0 in 0.834s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Creating direct copy from snapshot {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aabc8b3-058f-40a0-8f28-3b04dd305c06]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:19 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c.f3e305b4-c8a4-473a-a57d-92b661e8f0d3" returned: 0 in 0.667s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:19 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d Jun 19 04:23:19 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-quobyte-f3e305b4-c8a4-473a-a57d-92b661e8f0d3" released by "_delete_snapshot" :: held 3.902s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-quobyte-7c2947ce-45e3-4846-be8b-03bc57d3373c" released by "delete_snapshot" :: held 3.932s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Created reservations ['7a052c35-43b7-4359-8b1c-a29ec7dc2194', '26e4a7cd-6500-4b4c-ab1d-90809e374662', '9996a812-2086-4ca4-9438-d75d5170c84f', 'cdef3948-2c21-48e6-8853-a6481d204486'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:19 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Delete snapshot completed successfully. Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bed6aaf7-ec02-4020-af76-659cf6f8b0d4 tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-f3e305b4-c8a4-473a-a57d-92b661e8f0d3-delete_snapshot" released by "delete_snapshot" :: held 4.090s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "cinder-7c2947ce-45e3-4846-be8b-03bc57d3373c-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-7c2947ce-45e3-4846-be8b-03bc57d3373c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "cinder-quobyte-7c2947ce-45e3-4846-be8b-03bc57d3373c" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-quobyte-7c2947ce-45e3-4846-be8b-03bc57d3373c" acquired by "delete_volume" :: waited 0.014s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e332210-5b7d-4c73-9edc-9cacc568789f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:19 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c Jun 19 04:23:19 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:19 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d" returned: 0 in 0.820s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG cinder.utils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Path /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37 not found in is_blk_device check {{(pid=93530) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:23:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:19 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37 Jun 19 04:23:19 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:20 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c" returned: 0 in 0.891s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:20 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c Jun 19 04:23:20 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:22 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7c2947ce-45e3-4846-be8b-03bc57d3373c" returned: 0 in 1.614s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-quobyte-7c2947ce-45e3-4846-be8b-03bc57d3373c" released by "delete_volume" :: held 2.611s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:22 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Created reservations ['269e9986-3260-4d00-a2b7-2975e64986c7', '5687dc5c-bb3d-4cc4-94eb-bb4658c70caa', '0f89be6d-6657-484c-8c9a-c41e26ff24bd', '0876992d-a554-4075-b522-40c99174f994'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:22 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:23:22 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:24 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.810s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:24 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:24 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Deleted volume successfully. Jun 19 04:23:24 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-64ba0065-0219-4641-a4d0-4c0d36df1cfd tempest-VolumesSnapshotListTestJSON-675772530 None] Lock "cinder-7c2947ce-45e3-4846-be8b-03bc57d3373c-delete_volume" released by "delete_volume" :: held 4.886s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:27 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37" returned: 0 in 8.060s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:27 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f62e73-2890-46b9-b4eb-62a45a0bcfc8]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:28 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d Jun 19 04:23:28 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:29 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d" returned: 0 in 1.099s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:29 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Image conversion details: src /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d, size 1024.00 MB, duration 8.06 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:23:29 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Converted 1024.00 MB image at 127.02 MB/s Jun 19 04:23:29 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37 is being set with open permissions: ugo+rw Jun 19 04:23:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:29 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37 Jun 19 04:23:29 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:29 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37" returned: 0 in 0.713s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:29 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-49635c28-327c-40d2-8c47-d9565bb15d37" released by "_copy_volume_from_snapshot" :: held 11.666s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:29 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-a42b01cd-fa3d-474b-bd70-aaa856039877-49635c28-327c-40d2-8c47-d9565bb15d37" released by "_create_volume_from_snapshot" :: held 11.731s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.755s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f552245-1533-4274-84da-739b84c37628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49635c28-327c-40d2-8c47-d9565bb15d37', 'volume_size': 2, 'snapshot_id': 'a42b01cd-fa3d-474b-bd70-aaa856039877'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0297ad-b105-43d9-898b-c05b601a2551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:29 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Volume volume-49635c28-327c-40d2-8c47-d9565bb15d37 (49635c28-327c-40d2-8c47-d9565bb15d37): created successfully Jun 19 04:23:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0297ad-b105-43d9-898b-c05b601a2551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Flow 'volume_create_manager' (0318f089-dd2b-4577-a794-cc58b361b578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:29 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-6c783338-a347-4696-990d-8c3508c87454 tempest-VolumesSnapshotTestJSON-1578547850 None] Created volume successfully. Jun 19 04:23:30 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-49635c28-327c-40d2-8c47-d9565bb15d37-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:30 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-49635c28-327c-40d2-8c47-d9565bb15d37-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:30 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-49635c28-327c-40d2-8c47-d9565bb15d37" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:30 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-49635c28-327c-40d2-8c47-d9565bb15d37" acquired by "delete_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:30 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea572db6-0b89-46f6-8b8a-b75b2efb407f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:30 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37 Jun 19 04:23:30 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:32 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37" returned: 0 in 1.736s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:32 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37 Jun 19 04:23:32 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:34 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-49635c28-327c-40d2-8c47-d9565bb15d37" returned: 0 in 1.698s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:34 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-49635c28-327c-40d2-8c47-d9565bb15d37" released by "delete_volume" :: held 3.501s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:34 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Created reservations ['a92c74bd-094f-4f03-84b6-25d7f0e2bd70', '17da26b3-a852-472b-ad58-366773ad5393', '5b402b5e-cd28-4c83-baba-f403e8964b96', '9ae3410f-15d3-46d7-bb37-5b7ea4b59c59'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:34 devstack sudo[104802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:23:34 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-a42b01cd-fa3d-474b-bd70-aaa856039877-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-a42b01cd-fa3d-474b-bd70-aaa856039877-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-d8b53369-a34a-45ce-96c5-ce53d5bf320d" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-d8b53369-a34a-45ce-96c5-ce53d5bf320d" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-a42b01cd-fa3d-474b-bd70-aaa856039877" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-a42b01cd-fa3d-474b-bd70-aaa856039877" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Deleting offline snapshot a42b01cd-fa3d-474b-bd70-aaa856039877 of volume d8b53369-a34a-45ce-96c5-ce53d5bf320d {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:23:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] snapshot_file for this snap is: volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:23:35 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c57761-a1c7-4ac8-b6ab-dd1d8876ed35]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:36 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.610s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:36 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:36 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 Jun 19 04:23:36 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:36 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Deleted volume successfully. Jun 19 04:23:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bd45411a-fd67-4cd1-977d-522698446c0f tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-49635c28-327c-40d2-8c47-d9565bb15d37-delete_volume" released by "delete_volume" :: held 5.500s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:37 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877" returned: 0 in 1.215s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:23:37 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bad7545-b911-400c-bc0b-f0033a7b886d]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:37 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d Jun 19 04:23:37 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:38 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d" returned: 0 in 1.244s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:38 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 Jun 19 04:23:38 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:39 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877" returned: 0 in 1.022s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:39 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877 Jun 19 04:23:39 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:40 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d.a42b01cd-fa3d-474b-bd70-aaa856039877" returned: 0 in 1.256s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:40 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=91,cinder:SELECT=87,cinder:INSERT=20,cinder:DELETE=7 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:23:40 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=90,cinder:SELECT=85,cinder:INSERT=25,cinder:DELETE=10 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:23:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-a42b01cd-fa3d-474b-bd70-aaa856039877" released by "_delete_snapshot" :: held 5.045s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-d8b53369-a34a-45ce-96c5-ce53d5bf320d" released by "delete_snapshot" :: held 5.095s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:40 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Created reservations ['0fca89f9-501d-463c-8999-2ac5858263b3', '082b55b0-6fed-4ede-96f8-d88256621aca', '5f152c43-514c-4f02-b0e9-2cea6d6adfe2', 'd60f1255-68ca-4d01-8128-85ff5bc454fc'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:40 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Delete snapshot completed successfully. Jun 19 04:23:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b458d350-2694-4048-b50a-fb83ea04a155 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-a42b01cd-fa3d-474b-bd70-aaa856039877-delete_snapshot" released by "delete_snapshot" :: held 5.338s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-d8b53369-a34a-45ce-96c5-ce53d5bf320d-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-d8b53369-a34a-45ce-96c5-ce53d5bf320d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-d8b53369-a34a-45ce-96c5-ce53d5bf320d" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-d8b53369-a34a-45ce-96c5-ce53d5bf320d" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:41 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef6b2e2-b1c6-44e6-9622-aa76e6c7c70b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:41 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d Jun 19 04:23:41 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:42 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d" returned: 0 in 1.041s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:42 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d Jun 19 04:23:42 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:43 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8b53369-a34a-45ce-96c5-ce53d5bf320d" returned: 0 in 1.059s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-d8b53369-a34a-45ce-96c5-ce53d5bf320d" released by "delete_volume" :: held 2.208s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:43 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Created reservations ['955a18ad-4a30-4008-be20-b0db85397686', 'ed232e61-1cc4-4de5-a656-dacfe7106d4a', 'a9d44af1-4847-4b71-b653-8f8528567ac5', '15f855bc-866c-4f64-b684-678cd84987f6'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:43 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:23:43 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:45 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.525s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:45 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:45 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Deleted volume successfully. Jun 19 04:23:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3d3530b2-0df1-43ac-9868-6b6cc1530ca5 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-d8b53369-a34a-45ce-96c5-ce53d5bf320d-delete_volume" released by "delete_volume" :: held 4.174s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:45 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Flow 'volume_create_manager' (6f4b9c8f-fa36-48dc-9c08-54d79e99e9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0d7a78-8f0a-462d-9d39-3f9f4db68c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0d7a78-8f0a-462d-9d39-3f9f4db68c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1787880210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0820052-f3d8-4366-8838-18c08957a00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c68afe099e49ccaf7a0cd31ef88e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:46Z,use_quota=True,user_id='ec6adceb18bc49e2b15acad9c769b686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c8d79d-2b8b-4966-8a94-c043471439db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3c8d79d-2b8b-4966-8a94-c043471439db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a06b3ce-6c98-4a8a-9c80-ba0d1aa452f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a06b3ce-6c98-4a8a-9c80-ba0d1aa452f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0820052-f3d8-4366-8838-18c08957a00a', 'volume_name': 'volume-d0820052-f3d8-4366-8838-18c08957a00a', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73d6413-b9ee-49d9-bf82-c7297d3e1188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73d6413-b9ee-49d9-bf82-c7297d3e1188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821a5ae5-ba25-4517-8331-3bbb21f2b0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:46 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Volume d0820052-f3d8-4366-8838-18c08957a00a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0820052-f3d8-4366-8838-18c08957a00a', 'volume_size': 1} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1787880210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0820052-f3d8-4366-8838-18c08957a00a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c68afe099e49ccaf7a0cd31ef88e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:46Z,use_quota=True,user_id='ec6adceb18bc49e2b15acad9c769b686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Creating volume d0820052-f3d8-4366-8838-18c08957a00a {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:46 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:23:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:46 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a 1073741824 Jun 19 04:23:46 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:47 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a 1073741824" returned: 0 in 1.092s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:47 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a Jun 19 04:23:47 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:47 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a" returned: 0 in 0.759s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:23:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (821a5ae5-ba25-4517-8331-3bbb21f2b0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0820052-f3d8-4366-8838-18c08957a00a', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9474d8c2-1da9-4841-962b-bfc2e9881947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:47 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Volume volume-d0820052-f3d8-4366-8838-18c08957a00a (d0820052-f3d8-4366-8838-18c08957a00a): created successfully Jun 19 04:23:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9474d8c2-1da9-4841-962b-bfc2e9881947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Flow 'volume_create_manager' (6f4b9c8f-fa36-48dc-9c08-54d79e99e9de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:48 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-be31c706-47a2-47f0-97b9-f1172f34a010 tempest-VolumesSnapshotTestJSON-1578547850 None] Created volume successfully. Jun 19 04:23:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] Creating offline snapshot 2354a310-221f-44da-9024-49066da1a61c of volume d0820052-f3d8-4366-8838-18c08957a00a {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:23:49 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f66cc56-1823-4ac5-ba33-1deb2d28e6bc]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:49 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a Jun 19 04:23:49 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:50 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a" returned: 0 in 0.905s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:50 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c 1G Jun 19 04:23:50 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:51 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c 1G" returned: 0 in 1.161s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0820052-f3d8-4366-8838-18c08957a00a -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:51 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0820052-f3d8-4366-8838-18c08957a00a -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c Jun 19 04:23:51 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Acquiring lock "cinder-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Lock "cinder-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Acquiring lock "cinder-quobyte-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Lock "cinder-quobyte-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f" acquired by "delete_volume" :: waited 0.026s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:51 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[164aa5e8-680f-4202-a9cd-1be266aece33]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:51 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f Jun 19 04:23:51 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:52 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0820052-f3d8-4366-8838-18c08957a00a -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c" returned: 0 in 0.878s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:52 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c is being set with open permissions: ugo+rw Jun 19 04:23:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:52 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c Jun 19 04:23:52 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:52 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f" returned: 0 in 0.936s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:52 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f Jun 19 04:23:52 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:53 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c" returned: 0 in 0.745s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:53 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.info Jun 19 04:23:53 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:53 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f" returned: 0 in 0.686s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Lock "cinder-quobyte-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f" released by "delete_volume" :: held 1.659s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:53 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Created reservations ['9d9c866b-1d1c-4650-a57f-b76b8a8922f4', '069546eb-9206-47af-a2f7-c5283e4a9d7b', 'c833c625-78bf-41b0-83eb-ef8c7924dbf5', 'f7bce266-9f15-4e89-9e8c-7d7484dcc910'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:53 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:23:53 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:53 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.info" returned: 0 in 0.764s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:53 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.info is being set with open permissions: ugo+rw Jun 19 04:23:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:53 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.info Jun 19 04:23:53 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:54 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.782s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:54 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:54 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Deleted volume successfully. Jun 19 04:23:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-782f78ac-2488-47bf-b745-58ef23c3d19e tempest-VolumesNegativeTest-1232941544 None] Lock "cinder-82d4b8fd-3468-49c1-9f44-f2a55ff4a22f-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:54 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.info" returned: 0 in 0.821s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.391s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:54 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-880cfe56-c70f-46b7-a421-563b38bdb186 tempest-VolumesSnapshotTestJSON-1578547850 None] Create snapshot completed successfully Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Flow 'volume_create_manager' (248176a5-9f2f-463b-af39-5bd9325a6527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c540c0-6e31-4739-af0f-e6b64f639e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c540c0-6e31-4739-af0f-e6b64f639e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-246271161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4977d33f-fc3a-4c85-8640-f1524c003743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c68afe099e49ccaf7a0cd31ef88e21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2354a310-221f-44da-9024-49066da1a61c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:56Z,use_quota=True,user_id='ec6adceb18bc49e2b15acad9c769b686',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708d19bd-01a6-40c1-b6e2-90d48ac76d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708d19bd-01a6-40c1-b6e2-90d48ac76d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c873da81-75d6-46a1-8138-4029fdd9327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c873da81-75d6-46a1-8138-4029fdd9327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4977d33f-fc3a-4c85-8640-f1524c003743', 'volume_name': 'volume-4977d33f-fc3a-4c85-8640-f1524c003743', 'volume_size': 1, 'snapshot_id': '2354a310-221f-44da-9024-49066da1a61c'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce04697-4080-4a24-bf9a-b16daebfe254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce04697-4080-4a24-bf9a-b16daebfe254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df3d156-bf29-47d9-8683-02006b7dd418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:56 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Volume 4977d33f-fc3a-4c85-8640-f1524c003743: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4977d33f-fc3a-4c85-8640-f1524c003743', 'volume_size': 1, 'snapshot_id': '2354a310-221f-44da-9024-49066da1a61c'} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-2354a310-221f-44da-9024-49066da1a61c-4977d33f-fc3a-4c85-8640-f1524c003743" by "_create_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-2354a310-221f-44da-9024-49066da1a61c-4977d33f-fc3a-4c85-8640-f1524c003743" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Creating volume 4977d33f-fc3a-4c85-8640-f1524c003743 from snapshot 2354a310-221f-44da-9024-49066da1a61c {{(pid=93530) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-4977d33f-fc3a-4c85-8640-f1524c003743" by "_copy_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-4977d33f-fc3a-4c85-8640-f1524c003743" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] snapshot: 2354a310-221f-44da-9024-49066da1a61c, volume: 4977d33f-fc3a-4c85-8640-f1524c003743, {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f029ad-d76c-4cad-a030-273721ea2e83]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:57 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c Jun 19 04:23:57 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:57 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c" returned: 0 in 1.057s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0820052-f3d8-4366-8838-18c08957a00a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:23:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:23:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Creating direct copy from snapshot {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:23:57 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[141018cc-996f-40aa-aed6-f8f138ce0c3b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Flow 'volume_create_manager' (4f5ff4b4-aa31-4390-8692-74991bbeeb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c69c17-280a-420b-b94f-14be31081549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c69c17-280a-420b-b94f-14be31081549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1832212096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40643f16-e306-46da-bbe2-5ecf18f64bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a33b76d9ab047efb7798e0b541842d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:58Z,use_quota=True,user_id='3bca108914ce4d9f90fe05b5928619f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e49f80-b9d7-4d9e-8ed7-d1d82697354c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e49f80-b9d7-4d9e-8ed7-d1d82697354c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337658e2-f53c-465b-918b-2f4dcb1930a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337658e2-f53c-465b-918b-2f4dcb1930a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40643f16-e306-46da-bbe2-5ecf18f64bb6', 'volume_name': 'volume-40643f16-e306-46da-bbe2-5ecf18f64bb6', 'volume_size': 2}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617dd491-956f-4cfa-9f9d-3126a6ab6c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:58 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a Jun 19 04:23:58 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617dd491-956f-4cfa-9f9d-3126a6ab6c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bd43af-5b4f-49d8-9450-cb64044f7413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:58 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Volume 40643f16-e306-46da-bbe2-5ecf18f64bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40643f16-e306-46da-bbe2-5ecf18f64bb6', 'volume_size': 2} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:58 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a" returned: 0 in 0.918s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG cinder.utils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Path /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743 not found in is_blk_device check {{(pid=93530) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:58 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743 Jun 19 04:23:58 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:58 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:23:58 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:59 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.722s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:23:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:23:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:24:04 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743" returned: 0 in 5.938s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:04 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[db931dc1-f6f4-40c3-b9c5-cd478fdec6b1]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:04 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a Jun 19 04:24:04 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:05 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a" returned: 0 in 1.050s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:05 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Image conversion details: src /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:24:05 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Converted 1024.00 MB image at 172.41 MB/s Jun 19 04:24:05 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743 is being set with open permissions: ugo+rw Jun 19 04:24:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:05 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743 Jun 19 04:24:05 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:06 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743" returned: 0 in 0.749s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-4977d33f-fc3a-4c85-8640-f1524c003743" released by "_copy_volume_from_snapshot" :: held 9.828s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-2354a310-221f-44da-9024-49066da1a61c-4977d33f-fc3a-4c85-8640-f1524c003743" released by "_create_volume_from_snapshot" :: held 9.895s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.936s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.499s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1832212096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40643f16-e306-46da-bbe2-5ecf18f64bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a33b76d9ab047efb7798e0b541842d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:58Z,use_quota=True,user_id='3bca108914ce4d9f90fe05b5928619f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Creating volume 40643f16-e306-46da-bbe2-5ecf18f64bb6 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:06 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 2147483648 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:06 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 2147483648 Jun 19 04:24:06 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df3d156-bf29-47d9-8683-02006b7dd418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4977d33f-fc3a-4c85-8640-f1524c003743', 'volume_size': 1, 'snapshot_id': '2354a310-221f-44da-9024-49066da1a61c'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d246e58-2bd4-4a97-900f-474ef82066dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:06 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Volume volume-4977d33f-fc3a-4c85-8640-f1524c003743 (4977d33f-fc3a-4c85-8640-f1524c003743): created successfully Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d246e58-2bd4-4a97-900f-474ef82066dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Flow 'volume_create_manager' (248176a5-9f2f-463b-af39-5bd9325a6527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:06 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e722a1b5-258e-4336-9f77-a33920a729ba tempest-VolumesSnapshotTestJSON-1578547850 None] Created volume successfully. Jun 19 04:24:07 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 2147483648" returned: 0 in 0.969s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:07 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 Jun 19 04:24:07 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:07 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-4977d33f-fc3a-4c85-8640-f1524c003743-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:07 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-4977d33f-fc3a-4c85-8640-f1524c003743-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:07 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-4977d33f-fc3a-4c85-8640-f1524c003743" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:07 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-4977d33f-fc3a-4c85-8640-f1524c003743" acquired by "delete_volume" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:07 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9d3839-6b52-45e4-9f64-17cab10701b3]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:08 devstack sudo[105067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743 Jun 19 04:24:08 devstack sudo[105067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:08 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6" returned: 0 in 0.696s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:08 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bd43af-5b4f-49d8-9450-cb64044f7413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40643f16-e306-46da-bbe2-5ecf18f64bb6', 'volume_size': 2}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:08 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d71edf-7795-4df3-9cc8-02f5728d9c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:08 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Volume volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 (40643f16-e306-46da-bbe2-5ecf18f64bb6): created successfully Jun 19 04:24:08 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d71edf-7795-4df3-9cc8-02f5728d9c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:08 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Flow 'volume_create_manager' (4f5ff4b4-aa31-4390-8692-74991bbeeb73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:08 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-cd44075b-7dca-4a4d-a123-194d0bf15f4e tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Created volume successfully. Jun 19 04:24:08 devstack sudo[105067]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743" returned: 0 in 0.782s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:08 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743 Jun 19 04:24:08 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Creating offline snapshot 48673032-2565-4fd9-9644-703e27509089 of volume 40643f16-e306-46da-bbe2-5ecf18f64bb6 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:24:09 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[11732ddc-a119-498a-8fd8-c0996110ba61]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:09 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4977d33f-fc3a-4c85-8640-f1524c003743" returned: 0 in 0.724s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:09 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-4977d33f-fc3a-4c85-8640-f1524c003743" released by "delete_volume" :: held 1.557s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:09 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 Jun 19 04:24:09 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:09 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Created reservations ['0817b050-6f6c-4fe5-81d6-642a2ea438d3', '93b24d9a-2d47-4e78-baa3-7b1da9b023a8', 'acf814fc-3cba-43c5-8d9f-3a93dbb63fb8', '5dc176e1-8aaa-485a-b322-8966963d1c87'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:09 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:24:09 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-2354a310-221f-44da-9024-49066da1a61c-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-2354a310-221f-44da-9024-49066da1a61c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-d0820052-f3d8-4366-8838-18c08957a00a" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:10 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6" returned: 0 in 0.887s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 2G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-d0820052-f3d8-4366-8838-18c08957a00a" acquired by "delete_snapshot" :: waited 0.046s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-2354a310-221f-44da-9024-49066da1a61c" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-2354a310-221f-44da-9024-49066da1a61c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:10 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 2G Jun 19 04:24:10 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Deleting offline snapshot 2354a310-221f-44da-9024-49066da1a61c of volume d0820052-f3d8-4366-8838-18c08957a00a {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] snapshot_file for this snap is: volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6942907-565d-47b0-86a5-6ac7fbf48e75]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:10 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.792s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:10 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Deleted volume successfully. Jun 19 04:24:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c263459a-73a7-41a8-aff7-6de9f000022c tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-4977d33f-fc3a-4c85-8640-f1524c003743-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:10 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c Jun 19 04:24:10 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:11 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c" returned: 0 in 1.104s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0820052-f3d8-4366-8838-18c08957a00a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:24:11 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e64719-34ca-4fc2-8d5c-456ce8bdf86e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:11 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 2G" returned: 0 in 1.282s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:11 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 Jun 19 04:24:11 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:11 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a Jun 19 04:24:11 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:12 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089" returned: 0 in 1.022s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:12 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 is being set with open permissions: ugo+rw Jun 19 04:24:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:12 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 Jun 19 04:24:12 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:12 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a" returned: 0 in 1.138s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:12 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c Jun 19 04:24:12 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:13 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089" returned: 0 in 0.895s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:13 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.info Jun 19 04:24:13 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:13 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c" returned: 0 in 1.055s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:13 devstack sudo[105141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c Jun 19 04:24:13 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:14 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.info" returned: 0 in 0.761s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:14 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.info is being set with open permissions: ugo+rw Jun 19 04:24:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:14 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.info Jun 19 04:24:14 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:14 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a.2354a310-221f-44da-9024-49066da1a61c" returned: 0 in 0.792s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-2354a310-221f-44da-9024-49066da1a61c" released by "_delete_snapshot" :: held 4.236s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-d0820052-f3d8-4366-8838-18c08957a00a" released by "delete_snapshot" :: held 4.277s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:14 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Created reservations ['053ce9d8-86e0-41d7-b45e-bdd9072f5f47', '1455bbe2-6b3e-4145-99f0-ca6c493974a8', '85133243-4cb1-453b-9c8d-3f3f0748cee2', '8545cb22-b78c-471e-8bad-6c3bc6d11974'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:14 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Delete snapshot completed successfully. Jun 19 04:24:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c1a11e5-75db-494a-bb52-e3189cea0b67 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-2354a310-221f-44da-9024-49066da1a61c-delete_snapshot" released by "delete_snapshot" :: held 4.445s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:14 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.info" returned: 0 in 0.670s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.658s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:14 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-c48b70ce-0396-49c2-a463-45c40a59b023 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Create snapshot completed successfully Jun 19 04:24:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-7b1406b1-e10b-42cb-8db6-cd367d6e4caf req-8ff25d0e-daf4-4b47-a535-7262bf051977 tempest-AttachVolumeNegativeTest-1559506757 None] Terminate volume connection completed successfully. Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-7b1406b1-e10b-42cb-8db6-cd367d6e4caf req-8ff25d0e-daf4-4b47-a535-7262bf051977 tempest-AttachVolumeNegativeTest-1559506757 None] Deleting attachment 53e7a78c-9fe6-41f5-b8fb-6854f6ec3914. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-d0820052-f3d8-4366-8838-18c08957a00a-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-d0820052-f3d8-4366-8838-18c08957a00a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-d0820052-f3d8-4366-8838-18c08957a00a" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-d0820052-f3d8-4366-8838-18c08957a00a" acquired by "delete_volume" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c545a84a-135c-4450-8557-f38b6450bcdd]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Acquiring lock "cinder-48673032-2565-4fd9-9644-703e27509089-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:15 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a Jun 19 04:24:15 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "cinder-48673032-2565-4fd9-9644-703e27509089-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Acquiring lock "cinder-quobyte-40643f16-e306-46da-bbe2-5ecf18f64bb6" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "cinder-quobyte-40643f16-e306-46da-bbe2-5ecf18f64bb6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Acquiring lock "cinder-quobyte-48673032-2565-4fd9-9644-703e27509089" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "cinder-quobyte-48673032-2565-4fd9-9644-703e27509089" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Deleting offline snapshot 48673032-2565-4fd9-9644-703e27509089 of volume 40643f16-e306-46da-bbe2-5ecf18f64bb6 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] snapshot_file for this snap is: volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2af84d6-43a6-4039-a56a-353bcd968216]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:15 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 Jun 19 04:24:15 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:16 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a" returned: 0 in 0.837s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:16 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a Jun 19 04:24:16 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:16 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089" returned: 0 in 0.887s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40643f16-e306-46da-bbe2-5ecf18f64bb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:24:16 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f2fb9c-3641-41ac-bc54-ed43ea9ccaef]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:16 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 Jun 19 04:24:16 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:17 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d0820052-f3d8-4366-8838-18c08957a00a" returned: 0 in 0.711s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-d0820052-f3d8-4366-8838-18c08957a00a" released by "delete_volume" :: held 1.623s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:17 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Created reservations ['e9226f39-5d8a-4528-a174-858db779668b', 'd8670fca-2ac6-4496-9530-15558b0682d2', '588b9a20-e781-43c4-89ea-ffa47c94b099', '5825f0ca-8b85-4505-ae13-e6504164af93'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:17 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:24:17 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:17 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6" returned: 0 in 0.848s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:17 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 Jun 19 04:24:17 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-f9ba2853-339a-405f-a137-6508beb97dc4-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-f9ba2853-339a-405f-a137-6508beb97dc4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "cinder-quobyte-f9ba2853-339a-405f-a137-6508beb97dc4" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-f9ba2853-339a-405f-a137-6508beb97dc4" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:18 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f52d477-11d5-42c3-ae21-1717b11838a9]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:18 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.841s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:18 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:18 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Deleted volume successfully. Jun 19 04:24:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0eb97b59-d613-49e2-966d-95aeac4a0191 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-d0820052-f3d8-4366-8838-18c08957a00a-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:18 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4 Jun 19 04:24:18 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:18 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089" returned: 0 in 1.100s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:18 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089 Jun 19 04:24:18 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:19 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4" returned: 0 in 1.484s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:19 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4 Jun 19 04:24:19 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:19 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6.48673032-2565-4fd9-9644-703e27509089" returned: 0 in 1.192s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "cinder-quobyte-48673032-2565-4fd9-9644-703e27509089" released by "_delete_snapshot" :: held 4.187s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "cinder-quobyte-40643f16-e306-46da-bbe2-5ecf18f64bb6" released by "delete_snapshot" :: held 4.227s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:20 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Created reservations ['3264d8ab-c0e7-4f5d-ad74-f19326da6ab3', '6bbc8687-4e4c-4dfd-ad35-df92293e3a54', 'd1fc3ee5-dad2-4898-96fe-681bb2a8ca38', '00617452-5047-44a3-8492-542a95f5c36c'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:20 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Delete snapshot completed successfully. Jun 19 04:24:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32162cb0-b497-4d74-9086-53fc8c359ec7 tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "cinder-48673032-2565-4fd9-9644-703e27509089-delete_snapshot" released by "delete_snapshot" :: held 4.505s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:20 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f9ba2853-339a-405f-a137-6508beb97dc4" returned: 0 in 0.877s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-quobyte-f9ba2853-339a-405f-a137-6508beb97dc4" released by "delete_volume" :: held 2.438s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:20 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Created reservations ['a27b271f-563c-4f5a-b1aa-ced336d39b75', 'e736aef7-6fe6-440c-8964-44631d40755d', 'd3fbc62d-8a92-49b0-9f09-e39159dffa59', '689ead43-7eb2-45f5-9ac0-d7f06fd7e413'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:20 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:24:20 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Acquiring lock "cinder-40643f16-e306-46da-bbe2-5ecf18f64bb6-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "cinder-40643f16-e306-46da-bbe2-5ecf18f64bb6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Acquiring lock "cinder-quobyte-40643f16-e306-46da-bbe2-5ecf18f64bb6" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "cinder-quobyte-40643f16-e306-46da-bbe2-5ecf18f64bb6" acquired by "delete_volume" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:21 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbe3235-7c98-4c22-8317-730b9eadd0a2]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:21 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 Jun 19 04:24:21 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:22 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.522s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:22 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:22 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Deleted volume successfully. Jun 19 04:24:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a63bb8ab-1287-4dce-a047-0ad43c1cfcb6 tempest-VolumesSnapshotTestJSON-1578547850 None] Lock "cinder-f9ba2853-339a-405f-a137-6508beb97dc4-delete_volume" released by "delete_volume" :: held 4.285s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:22 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6" returned: 0 in 1.299s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:22 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6 Jun 19 04:24:22 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:23 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-40643f16-e306-46da-bbe2-5ecf18f64bb6" returned: 0 in 0.964s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "cinder-quobyte-40643f16-e306-46da-bbe2-5ecf18f64bb6" released by "delete_volume" :: held 2.405s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:24 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Created reservations ['0dc381d9-6fcf-46c1-abb1-ac675b1e4fa4', '19c90563-222b-4e81-afa2-c756017e755e', '200bf545-48d4-4d95-b4a2-b4bad721d7d4', 'f9a5d63f-a43b-4de7-bdcf-0bb5c817919d'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:24 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:24 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:24 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:24:24 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:25 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.292s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:25 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:25 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Deleted volume successfully. Jun 19 04:24:25 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-86b321f9-4955-4f82-a7a8-69f33b39ea7c tempest-VolumesSnapshotNegativeTestJSON-1679434226 None] Lock "cinder-40643f16-e306-46da-bbe2-5ecf18f64bb6-delete_volume" released by "delete_volume" :: held 4.150s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Flow 'volume_create_manager' (0e71eca7-3bff-4919-b970-5dbbdb108b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c71da4-03a4-413c-a36f-f6109e2fc81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c71da4-03a4-413c-a36f-f6109e2fc81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-521267248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ea9d33-f736-422f-9f54-067ba4f55878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3201d05711a46a0868f6b06f6b96ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:26Z,use_quota=True,user_id='f6e8e9ac269f47d8a9ae78f75ec769ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b22bfe-431b-4c4c-b886-f093ae773f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b22bfe-431b-4c4c-b886-f093ae773f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7cc81d-c293-4718-ab5e-4b5d5f7a22e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7cc81d-c293-4718-ab5e-4b5d5f7a22e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ea9d33-f736-422f-9f54-067ba4f55878', 'volume_name': 'volume-04ea9d33-f736-422f-9f54-067ba4f55878', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc1be73-2065-43cf-91ac-82f5b62c9a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc1be73-2065-43cf-91ac-82f5b62c9a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1f81b4-e1d1-458c-872b-83c55a2d50b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:26 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Volume 04ea9d33-f736-422f-9f54-067ba4f55878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ea9d33-f736-422f-9f54-067ba4f55878', 'volume_size': 1} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-521267248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ea9d33-f736-422f-9f54-067ba4f55878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3201d05711a46a0868f6b06f6b96ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:26Z,use_quota=True,user_id='f6e8e9ac269f47d8a9ae78f75ec769ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Creating volume 04ea9d33-f736-422f-9f54-067ba4f55878 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:26 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:24:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:26 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878 1073741824 Jun 19 04:24:26 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:27 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878 1073741824" returned: 0 in 1.477s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:27 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878 Jun 19 04:24:27 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:29 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878" returned: 0 in 1.334s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] <== create_volume: return (2889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.893s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1f81b4-e1d1-458c-872b-83c55a2d50b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ea9d33-f736-422f-9f54-067ba4f55878', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5642ed4a-9a20-4cdd-bd62-ca262d48972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:29 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Volume volume-04ea9d33-f736-422f-9f54-067ba4f55878 (04ea9d33-f736-422f-9f54-067ba4f55878): created successfully Jun 19 04:24:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5642ed4a-9a20-4cdd-bd62-ca262d48972c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Flow 'volume_create_manager' (0e71eca7-3bff-4919-b970-5dbbdb108b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:29 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-bdba0724-c74a-4475-b7bf-443fc0a45767 tempest-TestMinimumBasicScenario-1514771080 None] Created volume successfully. Jun 19 04:24:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-0a832b03-b4cb-45bf-834b-c88a9d2225a6 req-9568fbe0-f332-4ad3-a482-aa274312c815 tempest-TestMinimumBasicScenario-1514771080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-0a832b03-b4cb-45bf-834b-c88a9d2225a6 req-9568fbe0-f332-4ad3-a482-aa274312c815 tempest-TestMinimumBasicScenario-1514771080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:33 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace5631e-4ef1-45ff-b913-3c96399a889a]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-0a832b03-b4cb-45bf-834b-c88a9d2225a6 req-9568fbe0-f332-4ad3-a482-aa274312c815 tempest-TestMinimumBasicScenario-1514771080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:33 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878 Jun 19 04:24:33 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:34 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-0a832b03-b4cb-45bf-834b-c88a9d2225a6 req-9568fbe0-f332-4ad3-a482-aa274312c815 tempest-TestMinimumBasicScenario-1514771080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878" returned: 0 in 0.912s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-0a832b03-b4cb-45bf-834b-c88a9d2225a6 req-9568fbe0-f332-4ad3-a482-aa274312c815 tempest-TestMinimumBasicScenario-1514771080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.943s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-0a832b03-b4cb-45bf-834b-c88a9d2225a6 req-9568fbe0-f332-4ad3-a482-aa274312c815 tempest-TestMinimumBasicScenario-1514771080 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-04ea9d33-f736-422f-9f54-067ba4f55878', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d80244d-a37a-4883-ac7e-b3e13fe010c7', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:24:34 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-0a832b03-b4cb-45bf-834b-c88a9d2225a6 req-9568fbe0-f332-4ad3-a482-aa274312c815 tempest-TestMinimumBasicScenario-1514771080 None] attachment_update completed successfully. Jun 19 04:24:44 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=63,cinder:INSERT=19,cinder:UPDATE=90,cinder:DELETE=6 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:24:44 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=73,cinder:INSERT=22,cinder:UPDATE=71,cinder:DELETE=6 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:24:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:24:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:58 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:24:58 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:59 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.782s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:24:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:24:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Flow 'volume_create_manager' (9263678c-6b80-43fc-849f-d79333d73cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7291c73e-15bb-42a9-835e-e47b09d557dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7291c73e-15bb-42a9-835e-e47b09d557dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1607522815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89299bc-2263-40e1-bd80-84638a299e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b142eb15647d44c38e51b204ded81bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:18Z,use_quota=True,user_id='f625e5b51ccc46a48f881a49d43e35c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eb67e52-4f0d-4f37-bb30-25e38b16cc71),volume_type_id=2eb67e52-4f0d-4f37-bb30-25e38b16cc71)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8903f57f-885b-4d06-811f-d1b6ef791d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8903f57f-885b-4d06-811f-d1b6ef791d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0ee51d-6bd2-4543-8835-aa355098216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0ee51d-6bd2-4543-8835-aa355098216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89299bc-2263-40e1-bd80-84638a299e4e', 'volume_name': 'volume-a89299bc-2263-40e1-bd80-84638a299e4e', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d290fc69-bf54-477a-a93a-b9cf9fc3672c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d290fc69-bf54-477a-a93a-b9cf9fc3672c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a101cd-fb00-4dee-925a-bd75fb218afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:18 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Volume a89299bc-2263-40e1-bd80-84638a299e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89299bc-2263-40e1-bd80-84638a299e4e', 'volume_size': 1} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1607522815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89299bc-2263-40e1-bd80-84638a299e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b142eb15647d44c38e51b204ded81bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:18Z,use_quota=True,user_id='f625e5b51ccc46a48f881a49d43e35c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eb67e52-4f0d-4f37-bb30-25e38b16cc71),volume_type_id=2eb67e52-4f0d-4f37-bb30-25e38b16cc71)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Creating volume a89299bc-2263-40e1-bd80-84638a299e4e {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:18 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:18 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e 1073741824 Jun 19 04:25:18 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Flow 'volume_create_manager' (7e6ac466-b7c1-4aca-ba3e-811f58c85dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c250a5-adc5-41dc-aef0-32a19494eb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c250a5-adc5-41dc-aef0-32a19494eb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-379952287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255964c1-f962-4905-85a1-2e086a60a970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b142eb15647d44c38e51b204ded81bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:18Z,use_quota=True,user_id='f625e5b51ccc46a48f881a49d43e35c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c10677e0-beb2-4fda-a79f-9911bf7ad5d3),volume_type_id=c10677e0-beb2-4fda-a79f-9911bf7ad5d3)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302be5ec-920c-4ebc-a061-614167327829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (302be5ec-920c-4ebc-a061-614167327829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e62c56-fb23-469d-acfd-bb6b22d25eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e62c56-fb23-469d-acfd-bb6b22d25eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '255964c1-f962-4905-85a1-2e086a60a970', 'volume_name': 'volume-255964c1-f962-4905-85a1-2e086a60a970', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34b74a5-8a5d-4c22-8fe9-27773533eee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a34b74a5-8a5d-4c22-8fe9-27773533eee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1a8fc7-27f2-4e62-997a-31430a119b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:18 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Volume 255964c1-f962-4905-85a1-2e086a60a970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-255964c1-f962-4905-85a1-2e086a60a970', 'volume_size': 1} Jun 19 04:25:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:19 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Flow 'volume_create_manager' (feaa44c6-211a-42ec-9b8c-72a8ad05acdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77498d68-c1f8-4db3-b63b-1b255bbe6e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77498d68-c1f8-4db3-b63b-1b255bbe6e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1021932579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b142eb15647d44c38e51b204ded81bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:20Z,use_quota=True,user_id='f625e5b51ccc46a48f881a49d43e35c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e354742-a56b-4225-9136-d3880e4a67f1),volume_type_id=6e354742-a56b-4225-9136-d3880e4a67f1)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9586df1a-4c71-4c3e-b627-e1f96983c3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9586df1a-4c71-4c3e-b627-e1f96983c3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e5fc20-aa59-4f9a-9ab2-28a37bb29a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:19 devstack cinder-volume[93530]: DEBUG cinder.image.glance [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Creating Keystone auth plugin from conf {{(pid=93530) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:25:19 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e 1073741824" returned: 0 in 1.536s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:19 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e Jun 19 04:25:19 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5e5fc20-aa59-4f9a-9ab2-28a37bb29a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367', 'volume_name': 'volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367', 'volume_size': 1, 'image_id': 'b19fae38-a61a-49b1-b7b7-319190c04235', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b19fae38-a61a-49b1-b7b7-319190c04235', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--905575651', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b142eb15647d44c38e51b204ded81bf9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b19fae38-a61a-49b1-b7b7-319190c04235', 'created_at': datetime.datetime(2026, 6, 19, 2, 25, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 25, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b19fae38-a61a-49b1-b7b7-319190c04235/file', 'properties': {}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5e37f5-b6ab-4829-92b9-42ac311e33ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5e37f5-b6ab-4829-92b9-42ac311e33ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2906ba75-4b13-401a-8f4f-a5ed2fd33eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:20 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Volume 6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367', 'volume_size': 1, 'image_id': 'b19fae38-a61a-49b1-b7b7-319190c04235', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b19fae38-a61a-49b1-b7b7-319190c04235', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--905575651', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b142eb15647d44c38e51b204ded81bf9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b19fae38-a61a-49b1-b7b7-319190c04235', 'created_at': datetime.datetime(2026, 6, 19, 2, 25, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 25, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b19fae38-a61a-49b1-b7b7-319190c04235/file', 'properties': {}}, 'image_service': } Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Trying to clone 6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 from image b19fae38-a61a-49b1-b7b7-319190c04235 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b19fae38-a61a-49b1-b7b7-319190c04235', 'metadata': {}}]). {{(pid=93530) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:25:20 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e" returned: 0 in 0.964s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] <== create_volume: return (2557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.560s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.116s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-379952287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255964c1-f962-4905-85a1-2e086a60a970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b142eb15647d44c38e51b204ded81bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:18Z,use_quota=True,user_id='f625e5b51ccc46a48f881a49d43e35c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c10677e0-beb2-4fda-a79f-9911bf7ad5d3),volume_type_id=c10677e0-beb2-4fda-a79f-9911bf7ad5d3)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Creating volume 255964c1-f962-4905-85a1-2e086a60a970 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:20 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8a101cd-fb00-4dee-925a-bd75fb218afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89299bc-2263-40e1-bd80-84638a299e4e', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:20 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970 1073741824 Jun 19 04:25:20 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4023def2-1c39-4541-b0bc-c91371b6b27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:20 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Volume volume-a89299bc-2263-40e1-bd80-84638a299e4e (a89299bc-2263-40e1-bd80-84638a299e4e): created successfully Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4023def2-1c39-4541-b0bc-c91371b6b27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Flow 'volume_create_manager' (9263678c-6b80-43fc-849f-d79333d73cfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:20 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-8ed0dbd6-932a-4f59-bdfa-c67930fda0d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Created volume successfully. Jun 19 04:25:22 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970 1073741824" returned: 0 in 2.125s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:23 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970 Jun 19 04:25:23 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:24 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970" returned: 0 in 1.099s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:24 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] <== create_volume: return (3300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.303s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1a8fc7-27f2-4e62-997a-31430a119b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-255964c1-f962-4905-85a1-2e086a60a970', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca57783-e04e-4670-93a2-6b420ac539e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:24 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Volume volume-255964c1-f962-4905-85a1-2e086a60a970 (255964c1-f962-4905-85a1-2e086a60a970): created successfully Jun 19 04:25:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aca57783-e04e-4670-93a2-6b420ac539e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Flow 'volume_create_manager' (7e6ac466-b7c1-4aca-ba3e-811f58c85dd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:24 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-09fc35c5-f9a3-4a3d-be39-d330688d15d0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Created volume successfully. Jun 19 04:25:25 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b19fae38-a61a-49b1-b7b7-319190c04235_u2pr_etodevstack@QuobyteHD, size 20.69 MB, duration 5.50 sec {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:25:25 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Image download 20.69 MB at 3.76 MB/s Jun 19 04:25:25 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8057254-a573-41f6-ac51-c4d7ae560ab4]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19fae38-a61a-49b1-b7b7-319190c04235_u2pr_etodevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:26 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19fae38-a61a-49b1-b7b7-319190c04235_u2pr_etodevstack@QuobyteHD Jun 19 04:25:26 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:27 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19fae38-a61a-49b1-b7b7-319190c04235_u2pr_etodevstack@QuobyteHD" returned: 0 in 1.068s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:27 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Temporary image b19fae38-a61a-49b1-b7b7-319190c04235 is fetched for user f625e5b51ccc46a48f881a49d43e35c2. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:25:27 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[74418d63-bd3b-4261-bbaf-c7334e9a3b66]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19fae38-a61a-49b1-b7b7-319190c04235_u2pr_etodevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:27 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19fae38-a61a-49b1-b7b7-319190c04235_u2pr_etodevstack@QuobyteHD Jun 19 04:25:27 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:27 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19fae38-a61a-49b1-b7b7-319190c04235_u2pr_etodevstack@QuobyteHD" returned: 0 in 0.849s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1021932579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b142eb15647d44c38e51b204ded81bf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:20Z,use_quota=True,user_id='f625e5b51ccc46a48f881a49d43e35c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e354742-a56b-4225-9136-d3880e4a67f1),volume_type_id=6e354742-a56b-4225-9136-d3880e4a67f1)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Creating volume 6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:28 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:25:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:28 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 1073741824 Jun 19 04:25:28 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:29 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 1073741824" returned: 0 in 1.275s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:29 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 Jun 19 04:25:29 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:30 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367" returned: 0 in 0.806s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:30 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:30 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Attempting download of b19fae38-a61a-49b1-b7b7-319190c04235 ((None, [{'url': 'file:///opt/stack/data/glance/images/b19fae38-a61a-49b1-b7b7-319190c04235', 'metadata': {}}])) to volume 6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:25:30 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17c9419-e4af-4dff-b578-7c76e98b5196]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b19fae38-a61a-49b1-b7b7-319190c04235_hsdz6kly {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:30 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b19fae38-a61a-49b1-b7b7-319190c04235_hsdz6kly Jun 19 04:25:30 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:31 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b19fae38-a61a-49b1-b7b7-319190c04235_hsdz6kly" returned: 0 in 0.941s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b19fae38-a61a-49b1-b7b7-319190c04235_hsdz6kly {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:31 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b19fae38-a61a-49b1-b7b7-319190c04235_hsdz6kly Jun 19 04:25:31 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:32 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b19fae38-a61a-49b1-b7b7-319190c04235_hsdz6kly" returned: 1 in 0.811s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b19fae38-a61a-49b1-b7b7-319190c04235_hsdz6kly' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:25:32 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[5778bc90-7392-408a-ac9f-3b5ba6be157e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19fae38-a61a-49b1-b7b7-319190c04235_u2pr_etodevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:32 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19fae38-a61a-49b1-b7b7-319190c04235_u2pr_etodevstack@QuobyteHD Jun 19 04:25:32 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:32 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Flow 'volume_create_manager' (dce56270-4d23-47c6-83a6-b9df15c82503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603a7748-5afc-4de3-af43-b47088113fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603a7748-5afc-4de3-af43-b47088113fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1994422688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9603ec14-b977-4077-a25f-232eb13b504a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6e7ed100c349daa8feaa7e2c3af600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:33Z,use_quota=True,user_id='ac5ae4ff483d427384857ac156c72d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2732b5e8-2ad2-4d83-8a0d-8a69a41bb80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2732b5e8-2ad2-4d83-8a0d-8a69a41bb80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc2caf7-a20e-46f8-9a92-58581cecaa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc2caf7-a20e-46f8-9a92-58581cecaa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9603ec14-b977-4077-a25f-232eb13b504a', 'volume_name': 'volume-9603ec14-b977-4077-a25f-232eb13b504a', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b03dc2-2007-442b-8fdc-10deccb2f7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b03dc2-2007-442b-8fdc-10deccb2f7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6542875d-48ae-41d1-b748-7900a270ca24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:33 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Volume 9603ec14-b977-4077-a25f-232eb13b504a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9603ec14-b977-4077-a25f-232eb13b504a', 'volume_size': 1} Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1994422688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9603ec14-b977-4077-a25f-232eb13b504a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6e7ed100c349daa8feaa7e2c3af600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:33Z,use_quota=True,user_id='ac5ae4ff483d427384857ac156c72d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Creating volume 9603ec14-b977-4077-a25f-232eb13b504a {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:33 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:33 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a 1073741824 Jun 19 04:25:33 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:33 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b19fae38-a61a-49b1-b7b7-319190c04235_u2pr_etodevstack@QuobyteHD" returned: 0 in 1.065s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] b19fae38-a61a-49b1-b7b7-319190c04235 was qcow2, converting to raw {{(pid=93530) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b19fae38-a61a-49b1-b7b7-319190c04235_u2pr_etodevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:33 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b19fae38-a61a-49b1-b7b7-319190c04235_u2pr_etodevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 Jun 19 04:25:33 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:33 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a 1073741824" returned: 0 in 0.918s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:34 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a Jun 19 04:25:34 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:34 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a" returned: 0 in 0.712s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6542875d-48ae-41d1-b748-7900a270ca24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9603ec14-b977-4077-a25f-232eb13b504a', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060f3a34-8801-40b0-b2c8-6be8c3467ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:34 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Volume volume-9603ec14-b977-4077-a25f-232eb13b504a (9603ec14-b977-4077-a25f-232eb13b504a): created successfully Jun 19 04:25:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (060f3a34-8801-40b0-b2c8-6be8c3467ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Flow 'volume_create_manager' (dce56270-4d23-47c6-83a6-b9df15c82503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:34 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-fadf88d5-7051-4d8a-bbea-a50bf24f6476 tempest-AttachVolumeNegativeTest-1559506757 None] Created volume successfully. Jun 19 04:25:35 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b19fae38-a61a-49b1-b7b7-319190c04235_u2pr_etodevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367" returned: 0 in 1.949s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:35 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b19fae38-a61a-49b1-b7b7-319190c04235_u2pr_etodevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:25:35 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Converted 112.00 MB image at 57.42 MB/s Jun 19 04:25:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:35 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 1G Jun 19 04:25:35 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:35 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 1G" returned: 0 in 0.687s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:35 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9a39e1-9aa2-4488-8177-53849b5cfc33]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:35 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 Jun 19 04:25:35 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:36 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367" returned: 0 in 0.747s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:36 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 Jun 19 04:25:36 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:37 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367" returned: 1 in 0.791s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:25:37 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Downloaded image b19fae38-a61a-49b1-b7b7-319190c04235 ((None, [{'url': 'file:///opt/stack/data/glance/images/b19fae38-a61a-49b1-b7b7-319190c04235', 'metadata': {}}])) to volume 6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 successfully. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:25:37 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Temporary image b19fae38-a61a-49b1-b7b7-319190c04235 for user f625e5b51ccc46a48f881a49d43e35c2 is deleted. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:25:37 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Marking volume 6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 as bootable. {{(pid=93530) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:25:37 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Copying metadata from image b19fae38-a61a-49b1-b7b7-319190c04235 to 6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367. {{(pid=93530) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:25:37 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Creating volume glance metadata for volume 6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 backed by image b19fae38-a61a-49b1-b7b7-319190c04235 with: {'image_id': 'b19fae38-a61a-49b1-b7b7-319190c04235', 'image_name': 'tempest-scenario-img--905575651', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93530) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:25:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2906ba75-4b13-401a-8f4f-a5ed2fd33eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367', 'volume_size': 1, 'image_id': 'b19fae38-a61a-49b1-b7b7-319190c04235', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b19fae38-a61a-49b1-b7b7-319190c04235', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--905575651', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b142eb15647d44c38e51b204ded81bf9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b19fae38-a61a-49b1-b7b7-319190c04235', 'created_at': datetime.datetime(2026, 6, 19, 2, 25, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 25, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b19fae38-a61a-49b1-b7b7-319190c04235/file', 'properties': {}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee8197a-b16b-46a7-bddf-57bbea7b2db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:37 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Volume volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 (6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367): created successfully Jun 19 04:25:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee8197a-b16b-46a7-bddf-57bbea7b2db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Flow 'volume_create_manager' (feaa44c6-211a-42ec-9b8c-72a8ad05acdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:37 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-147a4c93-5633-4ef4-9189-f5695de561a2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Created volume successfully. Jun 19 04:25:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-db804148-2a83-4cb7-aa8b-938b37b5b845 req-fb7100a1-c91c-4e41-a44d-27a80b76a1d8 tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-db804148-2a83-4cb7-aa8b-938b37b5b845 req-fb7100a1-c91c-4e41-a44d-27a80b76a1d8 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:38 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe71b08-1bbf-4018-812f-d56b393aba63]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-db804148-2a83-4cb7-aa8b-938b37b5b845 req-fb7100a1-c91c-4e41-a44d-27a80b76a1d8 tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:38 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a Jun 19 04:25:38 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:38 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-db804148-2a83-4cb7-aa8b-938b37b5b845 req-fb7100a1-c91c-4e41-a44d-27a80b76a1d8 tempest-AttachVolumeNegativeTest-1559506757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a" returned: 0 in 0.759s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-db804148-2a83-4cb7-aa8b-938b37b5b845 req-fb7100a1-c91c-4e41-a44d-27a80b76a1d8 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.774s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-db804148-2a83-4cb7-aa8b-938b37b5b845 req-fb7100a1-c91c-4e41-a44d-27a80b76a1d8 tempest-AttachVolumeNegativeTest-1559506757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-9603ec14-b977-4077-a25f-232eb13b504a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90d26b6c-a0ff-45b6-af5b-e0c163d6c401', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:25:38 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-db804148-2a83-4cb7-aa8b-938b37b5b845 req-fb7100a1-c91c-4e41-a44d-27a80b76a1d8 tempest-AttachVolumeNegativeTest-1559506757 None] attachment_update completed successfully. Jun 19 04:25:45 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-1c5c572f-44bf-48c5-a688-e0fcdd7ec0da req-fe2536e5-357a-455c-b7cf-5091754fb550 tempest-AttachVolumeNegativeTest-1559506757 None] Terminate volume connection completed successfully. Jun 19 04:25:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-1c5c572f-44bf-48c5-a688-e0fcdd7ec0da req-fe2536e5-357a-455c-b7cf-5091754fb550 tempest-AttachVolumeNegativeTest-1559506757 None] Deleting attachment 90d26b6c-a0ff-45b6-af5b-e0c163d6c401. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:25:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-0c2d6f86-013e-474a-96ae-2eb56dd7f6cf req-988c36b4-af40-4501-a456-b2cab24a900c tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-0c2d6f86-013e-474a-96ae-2eb56dd7f6cf req-988c36b4-af40-4501-a456-b2cab24a900c tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:45 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3f2e58-bd14-419e-90f9-ddb16ee79c7a]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-0c2d6f86-013e-474a-96ae-2eb56dd7f6cf req-988c36b4-af40-4501-a456-b2cab24a900c tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:46 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 Jun 19 04:25:46 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:46 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-0c2d6f86-013e-474a-96ae-2eb56dd7f6cf req-988c36b4-af40-4501-a456-b2cab24a900c tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367" returned: 0 in 0.834s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-0c2d6f86-013e-474a-96ae-2eb56dd7f6cf req-988c36b4-af40-4501-a456-b2cab24a900c tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:46 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 Jun 19 04:25:46 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:47 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-0c2d6f86-013e-474a-96ae-2eb56dd7f6cf req-988c36b4-af40-4501-a456-b2cab24a900c tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367" returned: 1 in 0.911s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-0c2d6f86-013e-474a-96ae-2eb56dd7f6cf req-988c36b4-af40-4501-a456-b2cab24a900c tempest-TestInstancesWithCinderVolumes-2110526559 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:25:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-0c2d6f86-013e-474a-96ae-2eb56dd7f6cf req-988c36b4-af40-4501-a456-b2cab24a900c tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.788s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-0c2d6f86-013e-474a-96ae-2eb56dd7f6cf req-988c36b4-af40-4501-a456-b2cab24a900c tempest-TestInstancesWithCinderVolumes-2110526559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c6e9dfd-3688-4bf5-bdc2-7cc5d72c53a5', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:25:47 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-0c2d6f86-013e-474a-96ae-2eb56dd7f6cf req-988c36b4-af40-4501-a456-b2cab24a900c tempest-TestInstancesWithCinderVolumes-2110526559 None] attachment_update completed successfully. Jun 19 04:25:47 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Flow 'volume_create_manager' (76a13847-95a1-4d60-98ce-4c40cf34e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e880d6f-3e53-40ad-a472-0e8f71b348f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e880d6f-3e53-40ad-a472-0e8f71b348f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1444724369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628ef65d-e3f1-454f-816c-b2e95ce41a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378327aa20f2497cbb839666e96ac9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:48Z,use_quota=True,user_id='e9518bcc012143c3994bc2bee770319f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8935cb-dd48-4d91-b0a2-a9d49e167e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8935cb-dd48-4d91-b0a2-a9d49e167e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7dff9d-fd2c-4879-985a-7a9e6241a5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7dff9d-fd2c-4879-985a-7a9e6241a5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '628ef65d-e3f1-454f-816c-b2e95ce41a19', 'volume_name': 'volume-628ef65d-e3f1-454f-816c-b2e95ce41a19', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc06cd85-ea83-407e-91fd-39a6894dbdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc06cd85-ea83-407e-91fd-39a6894dbdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cdc9bb-5cbe-4d60-9f47-db0ba83f0b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:48 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Volume 628ef65d-e3f1-454f-816c-b2e95ce41a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-628ef65d-e3f1-454f-816c-b2e95ce41a19', 'volume_size': 1} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1444724369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628ef65d-e3f1-454f-816c-b2e95ce41a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='378327aa20f2497cbb839666e96ac9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:48Z,use_quota=True,user_id='e9518bcc012143c3994bc2bee770319f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Creating volume 628ef65d-e3f1-454f-816c-b2e95ce41a19 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:48 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:25:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:48 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19 1073741824 Jun 19 04:25:48 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:49 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19 1073741824" returned: 0 in 1.119s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:49 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19 Jun 19 04:25:49 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:49 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19" returned: 0 in 0.666s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cdc9bb-5cbe-4d60-9f47-db0ba83f0b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-628ef65d-e3f1-454f-816c-b2e95ce41a19', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1888d9c6-cc73-4eab-9fc2-58c1fd9b6765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:49 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Volume volume-628ef65d-e3f1-454f-816c-b2e95ce41a19 (628ef65d-e3f1-454f-816c-b2e95ce41a19): created successfully Jun 19 04:25:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1888d9c6-cc73-4eab-9fc2-58c1fd9b6765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Flow 'volume_create_manager' (76a13847-95a1-4d60-98ce-4c40cf34e8de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:49 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-5f66108d-f8b9-44e2-9ba7-1f373918c4a1 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Created volume successfully. Jun 19 04:25:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-d85dc2cf-6308-487f-b245-3ec32153faf9 req-673df081-eb69-4b3d-be0c-55fc1a0234ea tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-d85dc2cf-6308-487f-b245-3ec32153faf9 req-673df081-eb69-4b3d-be0c-55fc1a0234ea tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:54 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[60096131-df11-45f3-b7bc-c1f89c880626]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-d85dc2cf-6308-487f-b245-3ec32153faf9 req-673df081-eb69-4b3d-be0c-55fc1a0234ea tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:54 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19 Jun 19 04:25:54 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:55 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-d85dc2cf-6308-487f-b245-3ec32153faf9 req-673df081-eb69-4b3d-be0c-55fc1a0234ea tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19" returned: 0 in 1.205s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-d85dc2cf-6308-487f-b245-3ec32153faf9 req-673df081-eb69-4b3d-be0c-55fc1a0234ea tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.231s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-d85dc2cf-6308-487f-b245-3ec32153faf9 req-673df081-eb69-4b3d-be0c-55fc1a0234ea tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-628ef65d-e3f1-454f-816c-b2e95ce41a19', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'efb3ad44-3950-4de5-b5ba-203c733f66ff', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:25:55 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-d85dc2cf-6308-487f-b245-3ec32153faf9 req-673df081-eb69-4b3d-be0c-55fc1a0234ea tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] attachment_update completed successfully. Jun 19 04:25:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:25:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:59 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:25:59 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:00 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.453s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:00 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:00 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:26:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:26:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:26:00 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-08937dc5-8509-4468-8790-165e55570ca2 req-cd24dad6-23a5-4b85-9b6f-23b804e17147 tempest-TestMinimumBasicScenario-1514771080 None] Terminate volume connection completed successfully. Jun 19 04:26:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-08937dc5-8509-4468-8790-165e55570ca2 req-cd24dad6-23a5-4b85-9b6f-23b804e17147 tempest-TestMinimumBasicScenario-1514771080 None] Deleting attachment 4d80244d-a37a-4883-ac7e-b3e13fe010c7. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:26:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Acquiring lock "cinder-04ea9d33-f736-422f-9f54-067ba4f55878-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Lock "cinder-04ea9d33-f736-422f-9f54-067ba4f55878-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Acquiring lock "cinder-quobyte-04ea9d33-f736-422f-9f54-067ba4f55878" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Lock "cinder-quobyte-04ea9d33-f736-422f-9f54-067ba4f55878" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:03 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d470c80-3e45-458f-bc1c-8d0dd1eca666]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:03 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878 Jun 19 04:26:03 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:04 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-8b104567-83be-45d0-8627-f093e889356a req-0d51f46c-9e1a-4c5f-939e-388ccbb510ff tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Terminate volume connection completed successfully. Jun 19 04:26:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8b104567-83be-45d0-8627-f093e889356a req-0d51f46c-9e1a-4c5f-939e-388ccbb510ff tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Deleting attachment efb3ad44-3950-4de5-b5ba-203c733f66ff. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:26:04 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878" returned: 0 in 1.483s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:04 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878 Jun 19 04:26:04 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:05 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04ea9d33-f736-422f-9f54-067ba4f55878" returned: 0 in 0.985s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:05 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Lock "cinder-quobyte-04ea9d33-f736-422f-9f54-067ba4f55878" released by "delete_volume" :: held 2.531s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:05 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Created reservations ['28c05bc8-d4a7-4f3e-a4a6-328db6047392', '59ca0fef-c968-4028-97c6-05a232c5816c', '11329908-dc73-4c4b-bb4c-29e202919f8c', '3d72b6f9-3588-44c4-9651-e173c11f0c11'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:05 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:26:05 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Acquiring lock "cinder-628ef65d-e3f1-454f-816c-b2e95ce41a19-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Lock "cinder-628ef65d-e3f1-454f-816c-b2e95ce41a19-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Acquiring lock "cinder-quobyte-628ef65d-e3f1-454f-816c-b2e95ce41a19" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Lock "cinder-quobyte-628ef65d-e3f1-454f-816c-b2e95ce41a19" acquired by "delete_volume" :: waited 0.058s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:06 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[b719c812-74fa-4862-a2d5-eea1465f1990]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:06 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19 Jun 19 04:26:06 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:07 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.273s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:07 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:07 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Deleted volume successfully. Jun 19 04:26:07 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-fd2e4c4b-a3a5-4e52-af76-1cd97afc7b5a tempest-TestMinimumBasicScenario-1514771080 None] Lock "cinder-04ea9d33-f736-422f-9f54-067ba4f55878-delete_volume" released by "delete_volume" :: held 4.144s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:08 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19" returned: 0 in 1.421s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:08 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19 Jun 19 04:26:08 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:09 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-628ef65d-e3f1-454f-816c-b2e95ce41a19" returned: 0 in 1.408s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:09 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Lock "cinder-quobyte-628ef65d-e3f1-454f-816c-b2e95ce41a19" released by "delete_volume" :: held 2.949s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:09 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Created reservations ['3f7c29b0-9f1a-4136-ae62-edb3a8263b38', '68b3a52a-ba4c-481d-ba8c-093052391dff', 'fa47a738-6ea7-4a4a-98ac-500fbadd1b58', '3c2eed9a-af8a-4220-af21-e756578b2c50'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:09 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:26:09 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:11 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.228s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:11 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:11 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Deleted volume successfully. Jun 19 04:26:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-263a52f8-c22a-4649-98ee-85fd692d51a5 tempest-TestServerVolumeAttachScenarioOldVersion-130158355 None] Lock "cinder-628ef65d-e3f1-454f-816c-b2e95ce41a19-delete_volume" released by "delete_volume" :: held 4.693s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:19 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=43,cinder:SELECT=38,cinder:DELETE=4,cinder:INSERT=13 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:26:21 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=53,cinder:UPDATE=32,cinder:INSERT=9,cinder:DELETE=3 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:26:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-3c038d5d-af42-497c-a8f4-25b81c629a44 req-6b5e9748-b77c-4cdf-8e97-0880989062a9 tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-3c038d5d-af42-497c-a8f4-25b81c629a44 req-6b5e9748-b77c-4cdf-8e97-0880989062a9 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:29 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4b96cc-90b5-4e3a-a7a2-dde5b01ae1d5]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-3c038d5d-af42-497c-a8f4-25b81c629a44 req-6b5e9748-b77c-4cdf-8e97-0880989062a9 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:29 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e Jun 19 04:26:29 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:30 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-3c038d5d-af42-497c-a8f4-25b81c629a44 req-6b5e9748-b77c-4cdf-8e97-0880989062a9 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e" returned: 0 in 1.170s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-3c038d5d-af42-497c-a8f4-25b81c629a44 req-6b5e9748-b77c-4cdf-8e97-0880989062a9 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.201s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-3c038d5d-af42-497c-a8f4-25b81c629a44 req-6b5e9748-b77c-4cdf-8e97-0880989062a9 tempest-TestInstancesWithCinderVolumes-2110526559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-a89299bc-2263-40e1-bd80-84638a299e4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba71f623-0070-47b6-a13b-de8c0e9d79e7', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:26:30 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-3c038d5d-af42-497c-a8f4-25b81c629a44 req-6b5e9748-b77c-4cdf-8e97-0880989062a9 tempest-TestInstancesWithCinderVolumes-2110526559 None] attachment_update completed successfully. Jun 19 04:26:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-ac6e27cc-38c7-4ebb-a66c-8840aef6a7fe req-f2de4c28-3ecd-46f0-8863-6a5cbfa25514 tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-ac6e27cc-38c7-4ebb-a66c-8840aef6a7fe req-f2de4c28-3ecd-46f0-8863-6a5cbfa25514 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:38 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd8b36d-0c65-4dc8-89d3-fae6bf377ea9]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-ac6e27cc-38c7-4ebb-a66c-8840aef6a7fe req-f2de4c28-3ecd-46f0-8863-6a5cbfa25514 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:38 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970 Jun 19 04:26:38 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:39 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-ac6e27cc-38c7-4ebb-a66c-8840aef6a7fe req-f2de4c28-3ecd-46f0-8863-6a5cbfa25514 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970" returned: 0 in 0.994s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-ac6e27cc-38c7-4ebb-a66c-8840aef6a7fe req-f2de4c28-3ecd-46f0-8863-6a5cbfa25514 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.027s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:39 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-ac6e27cc-38c7-4ebb-a66c-8840aef6a7fe req-f2de4c28-3ecd-46f0-8863-6a5cbfa25514 tempest-TestInstancesWithCinderVolumes-2110526559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-255964c1-f962-4905-85a1-2e086a60a970', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89fd2ec9-dafa-4a96-869c-145f4bb8572b', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:26:39 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-ac6e27cc-38c7-4ebb-a66c-8840aef6a7fe req-f2de4c28-3ecd-46f0-8863-6a5cbfa25514 tempest-TestInstancesWithCinderVolumes-2110526559 None] attachment_update completed successfully. Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Flow 'volume_create_manager' (e36cad41-3b4a-4d46-91b3-a1bf282d6734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff14a5f3-b28b-4658-908b-7c62466e5b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff14a5f3-b28b-4658-908b-7c62466e5b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1247326512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c3e6d5-f443-4c9a-ad69-830ad3aff42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6e7ed100c349daa8feaa7e2c3af600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:47Z,use_quota=True,user_id='ac5ae4ff483d427384857ac156c72d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04dd825-567b-4518-b742-9c70da81a89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c04dd825-567b-4518-b742-9c70da81a89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802ca2bc-2aa9-4734-b229-6850b383f9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802ca2bc-2aa9-4734-b229-6850b383f9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77c3e6d5-f443-4c9a-ad69-830ad3aff42c', 'volume_name': 'volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad933e9-df6e-42ad-8fd2-51b040faa3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad933e9-df6e-42ad-8fd2-51b040faa3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8e65ab-0c8d-46bc-b072-d866fbac3956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:47 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Volume 77c3e6d5-f443-4c9a-ad69-830ad3aff42c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c', 'volume_size': 1} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1247326512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c3e6d5-f443-4c9a-ad69-830ad3aff42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae6e7ed100c349daa8feaa7e2c3af600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:47Z,use_quota=True,user_id='ac5ae4ff483d427384857ac156c72d98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Creating volume 77c3e6d5-f443-4c9a-ad69-830ad3aff42c {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:47 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:26:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:47 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c 1073741824 Jun 19 04:26:47 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:48 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c 1073741824" returned: 0 in 1.318s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:48 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c Jun 19 04:26:48 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:49 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c" returned: 0 in 1.103s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] <== create_volume: return (2504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.507s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8e65ab-0c8d-46bc-b072-d866fbac3956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d254b0d-4070-4a39-9df4-6c9d7ffeca31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:49 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Volume volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c (77c3e6d5-f443-4c9a-ad69-830ad3aff42c): created successfully Jun 19 04:26:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d254b0d-4070-4a39-9df4-6c9d7ffeca31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Flow 'volume_create_manager' (e36cad41-3b4a-4d46-91b3-a1bf282d6734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:49 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-4b355eeb-f325-4088-bfee-ff97a4e0c5b7 tempest-AttachVolumeNegativeTest-1559506757 None] Created volume successfully. Jun 19 04:26:51 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-865faf4c-b374-4bf0-bc23-b9674cd83200 req-e31b500e-54f7-403e-bac1-b6d270d6dd74 tempest-TestInstancesWithCinderVolumes-2110526559 None] Terminate volume connection completed successfully. Jun 19 04:26:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-865faf4c-b374-4bf0-bc23-b9674cd83200 req-e31b500e-54f7-403e-bac1-b6d270d6dd74 tempest-TestInstancesWithCinderVolumes-2110526559 None] Deleting attachment ba71f623-0070-47b6-a13b-de8c0e9d79e7. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:26:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "cinder-a89299bc-2263-40e1-bd80-84638a299e4e-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "cinder-a89299bc-2263-40e1-bd80-84638a299e4e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "cinder-quobyte-a89299bc-2263-40e1-bd80-84638a299e4e" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "cinder-quobyte-a89299bc-2263-40e1-bd80-84638a299e4e" acquired by "delete_volume" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:53 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c432cd-60b7-4298-96a9-66eaf66aa2d6]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:53 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e Jun 19 04:26:53 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-970fba80-e4d6-4e9e-95b3-8d899f19a4f9 req-0099a10e-38ab-4c28-bb8f-fe74687150f6 tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-970fba80-e4d6-4e9e-95b3-8d899f19a4f9 req-0099a10e-38ab-4c28-bb8f-fe74687150f6 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:53 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad736eac-1117-402d-bcdb-9fcc99002db3]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-970fba80-e4d6-4e9e-95b3-8d899f19a4f9 req-0099a10e-38ab-4c28-bb8f-fe74687150f6 tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:53 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c Jun 19 04:26:53 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:54 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e" returned: 0 in 1.067s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:54 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e Jun 19 04:26:54 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:54 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-970fba80-e4d6-4e9e-95b3-8d899f19a4f9 req-0099a10e-38ab-4c28-bb8f-fe74687150f6 tempest-AttachVolumeNegativeTest-1559506757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c" returned: 0 in 1.268s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-970fba80-e4d6-4e9e-95b3-8d899f19a4f9 req-0099a10e-38ab-4c28-bb8f-fe74687150f6 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.301s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-970fba80-e4d6-4e9e-95b3-8d899f19a4f9 req-0099a10e-38ab-4c28-bb8f-fe74687150f6 tempest-AttachVolumeNegativeTest-1559506757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0282719a-fe2c-47bd-ae18-ddafdbc41057', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:26:55 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-970fba80-e4d6-4e9e-95b3-8d899f19a4f9 req-0099a10e-38ab-4c28-bb8f-fe74687150f6 tempest-AttachVolumeNegativeTest-1559506757 None] attachment_update completed successfully. Jun 19 04:26:55 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a89299bc-2263-40e1-bd80-84638a299e4e" returned: 0 in 1.255s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "cinder-quobyte-a89299bc-2263-40e1-bd80-84638a299e4e" released by "delete_volume" :: held 2.397s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:55 devstack cinder-volume[93530]: WARNING cinder.quota [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1050283660-64757305 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1050283660-64757305, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:26:55 devstack cinder-volume[93530]: WARNING cinder.quota [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1050283660-64757305 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1050283660-64757305, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:26:55 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Created reservations ['5b725b72-220f-46f1-adfa-cda4dc558280', '7664a7ca-13ef-404e-8e79-154e237db841', '85ff008b-a291-46e6-ba41-ce4bb6a40a53', '5a66b1e6-ef4c-4bfd-9f4f-ca53331d761b'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:55 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:26:55 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:56 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.029s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:56 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:56 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Deleted volume successfully. Jun 19 04:26:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-859f78f4-dd52-43c4-85ce-274986b4c7a5 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "cinder-a89299bc-2263-40e1-bd80-84638a299e4e-delete_volume" released by "delete_volume" :: held 3.784s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:26:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:58 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:26:58 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:59 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-6f8f751d-7bc6-4ed0-a5c4-d87c9e8206ae req-847cf1f1-4bd0-44e9-8ad5-2ce37d2302f2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Terminate volume connection completed successfully. Jun 19 04:26:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-6f8f751d-7bc6-4ed0-a5c4-d87c9e8206ae req-847cf1f1-4bd0-44e9-8ad5-2ce37d2302f2 tempest-TestInstancesWithCinderVolumes-2110526559 None] Deleting attachment 89fd2ec9-dafa-4a96-869c-145f4bb8572b. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:27:00 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.078s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:00 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:00 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:27:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:27:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:27:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "cinder-255964c1-f962-4905-85a1-2e086a60a970-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "cinder-255964c1-f962-4905-85a1-2e086a60a970-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "cinder-quobyte-255964c1-f962-4905-85a1-2e086a60a970" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "cinder-quobyte-255964c1-f962-4905-85a1-2e086a60a970" acquired by "delete_volume" :: waited 0.030s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:01 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5d13eb-7d4f-49da-a11d-a928c1f79df7]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:01 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970 Jun 19 04:27:01 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:02 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-acd0fa73-9994-4a43-bf44-7ad4736d7367 req-adade2c8-7fd1-4eeb-8727-dba07687f01c tempest-AttachVolumeNegativeTest-1559506757 None] Terminate volume connection completed successfully. Jun 19 04:27:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-acd0fa73-9994-4a43-bf44-7ad4736d7367 req-adade2c8-7fd1-4eeb-8727-dba07687f01c tempest-AttachVolumeNegativeTest-1559506757 None] Deleting attachment 0282719a-fe2c-47bd-ae18-ddafdbc41057. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:27:02 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970" returned: 0 in 1.274s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:02 devstack sudo[107649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970 Jun 19 04:27:02 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:03 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-255964c1-f962-4905-85a1-2e086a60a970" returned: 0 in 0.993s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "cinder-quobyte-255964c1-f962-4905-85a1-2e086a60a970" released by "delete_volume" :: held 2.346s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:03 devstack cinder-volume[93530]: WARNING cinder.quota [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1082924524-1934095075 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1082924524-1934095075, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:27:03 devstack cinder-volume[93530]: WARNING cinder.quota [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1082924524-1934095075 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1082924524-1934095075, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:27:03 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Created reservations ['50813f59-3c71-4c03-868d-c6629ce76203', '59370ddc-b24c-4edb-b09d-26b733a2df82', 'ab1e1be0-bbcd-4386-951f-91ee452a2872', 'df8867e6-0e10-4e66-b9d4-71cd029b75a8'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:03 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:27:03 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:04 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.950s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:04 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:04 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Deleted volume successfully. Jun 19 04:27:04 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8f91de54-b2b8-40f3-8600-f4a354225d0e tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "cinder-255964c1-f962-4905-85a1-2e086a60a970-delete_volume" released by "delete_volume" :: held 3.712s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Flow 'volume_create_manager' (d9fcffde-7f66-4961-bc6d-441d87ab6f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cfb5c10-5d02-43ab-9aa1-9b0db011dab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cfb5c10-5d02-43ab-9aa1-9b0db011dab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1964491155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e21243-1b07-4ee0-b88f-d0cc8199e8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05e9f0b8c1a4b91a7c551ed7cc545e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:10Z,use_quota=True,user_id='3c0fc27e60e1429ba04e57ecd0c860b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9e5ec3-7fe5-4456-8e61-1a3578df0ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9e5ec3-7fe5-4456-8e61-1a3578df0ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b174f2a-d164-48ce-9a09-38ed7f20180b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b174f2a-d164-48ce-9a09-38ed7f20180b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33e21243-1b07-4ee0-b88f-d0cc8199e8d3', 'volume_name': 'volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7741e9d0-94f7-477c-896b-f04f5745f48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7741e9d0-94f7-477c-896b-f04f5745f48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf32960-d902-4858-b622-6350b4a40052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:10 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Volume 33e21243-1b07-4ee0-b88f-d0cc8199e8d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3', 'volume_size': 1} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1964491155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e21243-1b07-4ee0-b88f-d0cc8199e8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05e9f0b8c1a4b91a7c551ed7cc545e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:10Z,use_quota=True,user_id='3c0fc27e60e1429ba04e57ecd0c860b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Creating volume 33e21243-1b07-4ee0-b88f-d0cc8199e8d3 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:10 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:27:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:10 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 1073741824 Jun 19 04:27:10 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:11 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 1073741824" returned: 0 in 1.196s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:11 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 Jun 19 04:27:11 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:12 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-2f718ffe-bb95-4e79-8256-48b58c113d31 req-749f2f98-ab2d-45ae-9909-5de5ce2f6810 tempest-TestInstancesWithCinderVolumes-2110526559 None] Terminate volume connection completed successfully. Jun 19 04:27:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-2f718ffe-bb95-4e79-8256-48b58c113d31 req-749f2f98-ab2d-45ae-9909-5de5ce2f6810 tempest-TestInstancesWithCinderVolumes-2110526559 None] Deleting attachment 0c6e9dfd-3688-4bf5-bdc2-7cc5d72c53a5. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:27:12 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3" returned: 0 in 1.010s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:12 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] <== create_volume: return (2264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.267s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf32960-d902-4858-b622-6350b4a40052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090f8272-2882-40dc-b490-f911de96f7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:12 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Volume volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 (33e21243-1b07-4ee0-b88f-d0cc8199e8d3): created successfully Jun 19 04:27:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090f8272-2882-40dc-b490-f911de96f7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Flow 'volume_create_manager' (d9fcffde-7f66-4961-bc6d-441d87ab6f65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:12 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-67246db3-b9ee-4c55-ab76-beea23d49c68 tempest-TestStampPattern-1492869148 None] Created volume successfully. Jun 19 04:27:13 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Flow 'volume_create_manager' (17bb7c34-75d4-4886-a5d4-3f9bae5f61db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bda3bf-f051-48b1-b3c9-f5a39a389da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64bda3bf-f051-48b1-b3c9-f5a39a389da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-211712813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6089f160d594384811a5fa8acd2b149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:13Z,use_quota=True,user_id='8cd04d5b8cc3481bb375f3dc933dd044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1f2fd3-9d97-4f0b-8588-ee2ec5953eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc1f2fd3-9d97-4f0b-8588-ee2ec5953eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33720976-700f-4bc7-8b89-75d395becf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:13 devstack cinder-volume[93530]: DEBUG cinder.image.glance [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Creating Keystone auth plugin from conf {{(pid=93530) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:27:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33720976-700f-4bc7-8b89-75d395becf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5', 'volume_name': 'volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5', 'volume_size': 1, 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41c991745fb845ed91d69be55aec3c73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fadba52-38ad-4369-af5f-ef34870d8101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fadba52-38ad-4369-af5f-ef34870d8101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e4494c-95b6-4930-804a-b1963c5ee301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:13 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Volume 4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5', 'volume_size': 1, 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41c991745fb845ed91d69be55aec3c73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 19 04:27:13 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Trying to clone 4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 from image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]). {{(pid=93530) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:27:13 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_5qwrlt8fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:27:13 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Image download 20.69 MB at 20.69 MB/s Jun 19 04:27:14 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10208f3-deae-4a59-a9d5-26174373d218]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_5qwrlt8fdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:14 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_5qwrlt8fdevstack@QuobyteHD Jun 19 04:27:14 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "cinder-77c3e6d5-f443-4c9a-ad69-830ad3aff42c-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Lock "cinder-77c3e6d5-f443-4c9a-ad69-830ad3aff42c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "cinder-quobyte-77c3e6d5-f443-4c9a-ad69-830ad3aff42c" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Lock "cinder-quobyte-77c3e6d5-f443-4c9a-ad69-830ad3aff42c" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:14 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bc620b-bb57-439d-b02d-2ff0fe44a5fb]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:14 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c Jun 19 04:27:14 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:14 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_5qwrlt8fdevstack@QuobyteHD" returned: 0 in 0.795s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:14 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Temporary image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 is fetched for user 8cd04d5b8cc3481bb375f3dc933dd044. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:27:14 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe3479e-8ebe-4fca-81d0-f7e16e424b7d]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_5qwrlt8fdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:14 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_5qwrlt8fdevstack@QuobyteHD Jun 19 04:27:14 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:15 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c" returned: 0 in 0.826s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:15 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c Jun 19 04:27:15 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "cinder-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "cinder-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "cinder-quobyte-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "cinder-quobyte-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367" acquired by "delete_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[934effb1-7f2a-4c6e-a73d-2a2d587a07aa]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:15 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 Jun 19 04:27:15 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:15 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_5qwrlt8fdevstack@QuobyteHD" returned: 0 in 0.855s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-211712813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6089f160d594384811a5fa8acd2b149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:13Z,use_quota=True,user_id='8cd04d5b8cc3481bb375f3dc933dd044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Creating volume 4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:15 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:15 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 1073741824 Jun 19 04:27:15 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:15 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-77c3e6d5-f443-4c9a-ad69-830ad3aff42c" returned: 0 in 0.770s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Lock "cinder-quobyte-77c3e6d5-f443-4c9a-ad69-830ad3aff42c" released by "delete_volume" :: held 1.644s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:15 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Created reservations ['618585b8-5cca-4152-af35-7b89cf7af731', '3f68b7fe-c7b6-4f28-b909-38efb236db05', '60e0e40a-1b47-4218-a48d-c93abd528811', '4dde1ef1-4e26-4cf6-9e84-9b76d4757583'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:16 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:27:16 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:16 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367" returned: 0 in 0.886s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:16 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 Jun 19 04:27:16 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "cinder-9603ec14-b977-4077-a25f-232eb13b504a-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Lock "cinder-9603ec14-b977-4077-a25f-232eb13b504a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "cinder-quobyte-9603ec14-b977-4077-a25f-232eb13b504a" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Lock "cinder-quobyte-9603ec14-b977-4077-a25f-232eb13b504a" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[63df9822-702e-4e09-a454-e7f71f91df86]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:16 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 1073741824" returned: 0 in 1.006s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:16 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 Jun 19 04:27:16 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:16 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a Jun 19 04:27:16 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:17 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.886s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:17 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:17 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Deleted volume successfully. Jun 19 04:27:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-51d350dc-abb2-4f19-bf90-5956ed42126d tempest-AttachVolumeNegativeTest-1559506757 None] Lock "cinder-77c3e6d5-f443-4c9a-ad69-830ad3aff42c-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:17 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367" returned: 1 in 0.860s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:27:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:17 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367 Jun 19 04:27:17 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:17 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:17 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5" returned: 0 in 0.794s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a" returned: 0 in 0.899s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:17 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a Jun 19 04:27:17 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Attempting download of 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}])) to volume 4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:27:17 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:17 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[646801ba-2c5b-4ee5-9d2e-b61edfc2d942]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_xyy779xl {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:17 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_xyy779xl Jun 19 04:27:17 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:18 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367" returned: 0 in 0.869s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "cinder-quobyte-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367" released by "delete_volume" :: held 2.688s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:18 devstack cinder-volume[93530]: WARNING cinder.quota [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1989160540-1831417863 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1989160540-1831417863, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:27:18 devstack cinder-volume[93530]: WARNING cinder.quota [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1989160540-1831417863 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1989160540-1831417863, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Created reservations ['ecea4b9b-af71-4765-97f0-9c8858a68a48', '78575e19-e0dc-4dd6-831a-9f55b5bfe4d5', '9721855d-75b2-4795-a95f-f6b426b41fb1', 'b1d453ba-b976-4981-b006-383d2b80414f'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:18 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:27:18 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:18 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9603ec14-b977-4077-a25f-232eb13b504a" returned: 0 in 0.809s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Lock "cinder-quobyte-9603ec14-b977-4077-a25f-232eb13b504a" released by "delete_volume" :: held 1.757s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Created reservations ['acb01260-c7c5-4650-8bc0-4e642b62125e', 'dbce92c1-3a15-4cc3-9081-1c1f78e578d8', '62fd345c-4f00-45a6-b1bd-9dcc0f20fa8b', 'c6b46440-d00d-4da7-9753-7f147b8edc7e'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:18 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:27:18 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:18 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_xyy779xl" returned: 0 in 1.071s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_xyy779xl {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:18 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_xyy779xl Jun 19 04:27:18 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "cinder-d82646e2-cd15-4a1f-8982-98ae51914335-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "cinder-d82646e2-cd15-4a1f-8982-98ae51914335-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "cinder-quobyte-d82646e2-cd15-4a1f-8982-98ae51914335" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "cinder-quobyte-d82646e2-cd15-4a1f-8982-98ae51914335" acquired by "delete_volume" :: waited 0.034s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:19 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c1cf5d-24e2-49f9-9115-cd948b9d7d18]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:19 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.304s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:19 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:19 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Deleted volume successfully. Jun 19 04:27:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d22d67c4-b982-476e-b4db-9aa5a7b3e2e0 tempest-TestInstancesWithCinderVolumes-2110526559 None] Lock "cinder-6ff1dad4-3f66-4642-a5ac-4dbd5fc5c367-delete_volume" released by "delete_volume" :: held 4.387s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:19 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335 Jun 19 04:27:19 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:19 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.244s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:19 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:19 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Deleted volume successfully. Jun 19 04:27:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d32ef4da-1b58-4ee6-b510-acab5f02a31e tempest-AttachVolumeNegativeTest-1559506757 None] Lock "cinder-9603ec14-b977-4077-a25f-232eb13b504a-delete_volume" released by "delete_volume" :: held 3.396s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:20 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_xyy779xl" returned: 1 in 1.582s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_xyy779xl' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:27:20 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fa78f5-6303-4516-8c56-3e884c8ab9d4]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_5qwrlt8fdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:20 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_5qwrlt8fdevstack@QuobyteHD Jun 19 04:27:20 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:20 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335" returned: 0 in 1.302s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:20 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335 Jun 19 04:27:20 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:21 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_5qwrlt8fdevstack@QuobyteHD" returned: 0 in 1.023s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:21 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 was qcow2, converting to raw {{(pid=93530) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:27:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_5qwrlt8fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:21 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_5qwrlt8fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 Jun 19 04:27:21 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:21 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d82646e2-cd15-4a1f-8982-98ae51914335" returned: 0 in 1.048s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "cinder-quobyte-d82646e2-cd15-4a1f-8982-98ae51914335" released by "delete_volume" :: held 2.436s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:21 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=51,cinder:UPDATE=57,cinder:DELETE=5,cinder:INSERT=7 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:27:21 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=58,cinder:UPDATE=50,cinder:INSERT=17,cinder:DELETE=2 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:27:21 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Created reservations ['454f6334-111d-46d6-8369-e960ee0905ad', 'b28169a9-ec7a-406d-ba86-3af0b3cd53db', '018a8cb6-01f4-4143-ae8a-64d7bf1813f9', 'e4e4d667-6778-4455-8581-7587c09e1412'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:22 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:27:22 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:22 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.824s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:22 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:22 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Deleted volume successfully. Jun 19 04:27:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3634c7f9-a3da-4778-86ab-75daa09f2777 tempest-AttachVolumeNegativeTest-1559506757 None] Lock "cinder-d82646e2-cd15-4a1f-8982-98ae51914335-delete_volume" released by "delete_volume" :: held 3.634s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:23 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_5qwrlt8fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5" returned: 0 in 2.353s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:23 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6_5qwrlt8fdevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:27:23 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Converted 112.00 MB image at 47.58 MB/s Jun 19 04:27:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:23 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 1G Jun 19 04:27:23 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:24 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 1G" returned: 0 in 0.909s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:24 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8b394f-faeb-4243-a089-891a79f6c51f]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:24 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 Jun 19 04:27:24 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:25 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5" returned: 0 in 0.919s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:25 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 Jun 19 04:27:25 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:26 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5" returned: 1 in 0.934s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:27:26 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Downloaded image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}])) to volume 4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 successfully. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:27:26 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Temporary image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 for user 8cd04d5b8cc3481bb375f3dc933dd044 is deleted. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:27:26 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Marking volume 4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 as bootable. {{(pid=93530) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:27:26 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Copying metadata from image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 to 4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5. {{(pid=93530) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:27:26 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Creating volume glance metadata for volume 4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 backed by image 2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93530) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:27:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e4494c-95b6-4930-804a-b1963c5ee301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5', 'volume_size': 1, 'image_id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '41c991745fb845ed91d69be55aec3c73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d0b10c2-b90c-41b9-a8d8-5afd3a5a10f6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9efc1aa2-2abc-4f60-b6b5-d291c181130c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:26 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Volume volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 (4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5): created successfully Jun 19 04:27:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9efc1aa2-2abc-4f60-b6b5-d291c181130c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Flow 'volume_create_manager' (17bb7c34-75d4-4886-a5d4-3f9bae5f61db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:26 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ead1efaf-c34b-4782-acdf-616fbc5a44c8 tempest-TestShelveInstance-647203891 None] Created volume successfully. Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Flow 'volume_create_manager' (5fb085cf-f4d8-4be0-a223-221bcd853873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2cb1dbf-4fbb-4f62-a37b-28b563d9b4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2cb1dbf-4fbb-4f62-a37b-28b563d9b4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-194850339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf07faa-a111-4bd9-8d04-0dcbcd09105d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d07c1d1cbe824275a62053dd625baea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:34Z,use_quota=True,user_id='d448249fc5e149518ede8d67d42a02aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112d83c8-1319-4653-a11e-7a9856d50e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112d83c8-1319-4653-a11e-7a9856d50e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0454d25-71d0-41a2-aecd-c850e8685cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0454d25-71d0-41a2-aecd-c850e8685cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf07faa-a111-4bd9-8d04-0dcbcd09105d', 'volume_name': 'volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93303f2-d79f-426e-9dbd-a7f6e921338f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93303f2-d79f-426e-9dbd-a7f6e921338f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70f64e5-2c91-448b-805c-b90d1406e9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:34 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Volume abf07faa-a111-4bd9-8d04-0dcbcd09105d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d', 'volume_size': 1} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-194850339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf07faa-a111-4bd9-8d04-0dcbcd09105d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d07c1d1cbe824275a62053dd625baea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:34Z,use_quota=True,user_id='d448249fc5e149518ede8d67d42a02aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Creating volume abf07faa-a111-4bd9-8d04-0dcbcd09105d {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:34 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:27:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:34 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d 1073741824 Jun 19 04:27:34 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:36 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d 1073741824" returned: 0 in 1.403s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:36 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d Jun 19 04:27:36 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:36 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Flow 'volume_create_manager' (7f3e3b52-cf2c-4766-b47d-80956dcca91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500cc896-b274-4e9c-8e31-69050585cb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500cc896-b274-4e9c-8e31-69050585cb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-28436848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e92ddca-a50b-4cbf-b618-a52e5bebd6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54539fc8029b46c08a24d997cae66048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:36Z,use_quota=True,user_id='d2b6aec1c72a4628b76d80e5628126c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24b455a-367a-4c53-90e5-53fc15ceeb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24b455a-367a-4c53-90e5-53fc15ceeb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ee168c-7142-422e-b37a-dce91233e8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ee168c-7142-422e-b37a-dce91233e8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e92ddca-a50b-4cbf-b618-a52e5bebd6a1', 'volume_name': 'volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5a5d75-72c5-4460-949e-b962c6db90d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5a5d75-72c5-4460-949e-b962c6db90d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9ef89f-7504-483e-b9e4-b50efe4ce161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:36 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume 0e92ddca-a50b-4cbf-b618-a52e5bebd6a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1', 'volume_size': 1} Jun 19 04:27:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-ed54536d-2863-4c95-aa05-5b6f8259a94e req-658662a8-2f0d-4751-8bbc-4a3a7ad5cb98 tempest-TestShelveInstance-647203891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:37 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d" returned: 0 in 1.294s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] <== create_volume: return (2810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.815s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.080s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-28436848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e92ddca-a50b-4cbf-b618-a52e5bebd6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54539fc8029b46c08a24d997cae66048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:36Z,use_quota=True,user_id='d2b6aec1c72a4628b76d80e5628126c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Creating volume 0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:37 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:37 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 1073741824 Jun 19 04:27:37 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70f64e5-2c91-448b-805c-b90d1406e9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0c6497-424d-4d42-9c34-2c91f45dffbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:37 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Volume volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d (abf07faa-a111-4bd9-8d04-0dcbcd09105d): created successfully Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0c6497-424d-4d42-9c34-2c91f45dffbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Flow 'volume_create_manager' (5fb085cf-f4d8-4be0-a223-221bcd853873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:37 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-bea63dd6-39a9-4c14-8271-710b71dafd8f req-8870cca4-2b8f-4502-a583-5e55aa1a6650 tempest-VolumesGetTestJSON-1058172507 None] Created volume successfully. Jun 19 04:27:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Acquiring lock "cinder-abf07faa-a111-4bd9-8d04-0dcbcd09105d-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Lock "cinder-abf07faa-a111-4bd9-8d04-0dcbcd09105d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Acquiring lock "cinder-quobyte-abf07faa-a111-4bd9-8d04-0dcbcd09105d" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Lock "cinder-quobyte-abf07faa-a111-4bd9-8d04-0dcbcd09105d" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:38 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c724c947-7b6c-40c2-bc9e-e28120b68333]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:38 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d Jun 19 04:27:38 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:39 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 1073741824" returned: 0 in 1.809s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:39 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 Jun 19 04:27:39 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:40 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d" returned: 0 in 1.260s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:40 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d Jun 19 04:27:40 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:40 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1" returned: 0 in 1.032s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] <== create_volume: return (2946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.957s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-ed54536d-2863-4c95-aa05-5b6f8259a94e req-658662a8-2f0d-4751-8bbc-4a3a7ad5cb98 tempest-TestShelveInstance-647203891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.004s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9ef89f-7504-483e-b9e4-b50efe4ce161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0eaa3d6-96cc-40bb-9357-37d5a907b13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:40 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 (0e92ddca-a50b-4cbf-b618-a52e5bebd6a1): created successfully Jun 19 04:27:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0eaa3d6-96cc-40bb-9357-37d5a907b13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Flow 'volume_create_manager' (7f3e3b52-cf2c-4766-b47d-80956dcca91d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:40 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b78388-eb75-4799-a795-3715a6fde441]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-ed54536d-2863-4c95-aa05-5b6f8259a94e req-658662a8-2f0d-4751-8bbc-4a3a7ad5cb98 tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:40 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-06807c11-7ca8-4ea2-a8da-0f7ca3f44ff2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Created volume successfully. Jun 19 04:27:40 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 Jun 19 04:27:40 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:41 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-abf07faa-a111-4bd9-8d04-0dcbcd09105d" returned: 0 in 0.983s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Lock "cinder-quobyte-abf07faa-a111-4bd9-8d04-0dcbcd09105d" released by "delete_volume" :: held 2.313s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:41 devstack cinder-volume[93530]: DEBUG cinder.quota [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Created reservations ['303dc0e5-e8c4-4ec8-ad6b-f3ea6ce7fb4f', 'a827fc5a-07b8-4382-9c20-7920c86cddec', 'def8d8ab-c437-4454-a0e4-08005811ec67', '6c061035-b90d-421f-905e-f82ba27150b4'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:41 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:27:41 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:41 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-ed54536d-2863-4c95-aa05-5b6f8259a94e req-658662a8-2f0d-4751-8bbc-4a3a7ad5cb98 tempest-TestShelveInstance-647203891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5" returned: 0 in 1.173s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-ed54536d-2863-4c95-aa05-5b6f8259a94e req-658662a8-2f0d-4751-8bbc-4a3a7ad5cb98 tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:41 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 Jun 19 04:27:41 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:42 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.081s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:42 devstack cinder-volume[93530]: DEBUG cinder.manager [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:42 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Deleted volume successfully. Jun 19 04:27:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-07aa2673-c84c-442c-bac2-5205849b0feb req-3403ffe1-964e-4fd5-85c5-b4c848cf84bb tempest-VolumesGetTestJSON-1058172507 None] Lock "cinder-abf07faa-a111-4bd9-8d04-0dcbcd09105d-delete_volume" released by "delete_volume" :: held 3.719s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:42 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-ed54536d-2863-4c95-aa05-5b6f8259a94e req-658662a8-2f0d-4751-8bbc-4a3a7ad5cb98 tempest-TestShelveInstance-647203891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5" returned: 1 in 1.107s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-ed54536d-2863-4c95-aa05-5b6f8259a94e req-658662a8-2f0d-4751-8bbc-4a3a7ad5cb98 tempest-TestShelveInstance-647203891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:27:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-ed54536d-2863-4c95-aa05-5b6f8259a94e req-658662a8-2f0d-4751-8bbc-4a3a7ad5cb98 tempest-TestShelveInstance-647203891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.404s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.699s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:42 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] Creating offline snapshot 83053369-a8a5-4bae-82e9-923b0726b716 of volume 0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:27:42 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-ed54536d-2863-4c95-aa05-5b6f8259a94e req-658662a8-2f0d-4751-8bbc-4a3a7ad5cb98 tempest-TestShelveInstance-647203891 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3eb789ae-8b58-4f0e-bbeb-068798f077c1', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:27:42 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf69c57-ebb9-4c93-b8c8-5faaa550ca8b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:42 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-ed54536d-2863-4c95-aa05-5b6f8259a94e req-658662a8-2f0d-4751-8bbc-4a3a7ad5cb98 tempest-TestShelveInstance-647203891 None] attachment_update completed successfully. Jun 19 04:27:43 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 Jun 19 04:27:43 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:43 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1" returned: 0 in 1.053s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:43 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 1G Jun 19 04:27:43 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:45 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 1G" returned: 0 in 1.174s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:45 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 Jun 19 04:27:45 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:45 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716" returned: 0 in 0.870s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:45 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 is being set with open permissions: ugo+rw Jun 19 04:27:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:46 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 Jun 19 04:27:46 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:46 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716" returned: 0 in 0.713s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:46 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.info Jun 19 04:27:46 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:47 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.info" returned: 0 in 0.680s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:47 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.info is being set with open permissions: ugo+rw Jun 19 04:27:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:47 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.info Jun 19 04:27:47 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1da2eee0-bccb-40ca-8655-7e7d811171b6 tempest-BackendsCapabilitiesAdminTestsJSON-1519584621 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578201293945, 'free_capacity_gb': 1775.7578201293945, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93530) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 19 04:27:48 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.info" returned: 0 in 0.649s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.255s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:48 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d3664114-c181-4793-969b-1d7ba65ad3c9 tempest-CreateVolumesFromSnapshotTest-170809816 None] Create snapshot completed successfully Jun 19 04:27:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-98d58b91-0669-48ab-9f41-c2b55a1d209a tempest-BackendsCapabilitiesAdminTestsJSON-1519584621 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578201293945, 'free_capacity_gb': 1775.7578201293945, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93530) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 19 04:27:48 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Flow 'volume_create_manager' (7a04bc0d-fbae-46bd-a93a-0508e4cca9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecf0580-c022-4fb9-8d9b-be77f68a0332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecf0580-c022-4fb9-8d9b-be77f68a0332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1064732245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1740ce-2bdd-4890-bff1-84c214d0375f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54539fc8029b46c08a24d997cae66048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:49Z,use_quota=True,user_id='d2b6aec1c72a4628b76d80e5628126c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94e7484-2d8f-43d7-ba40-32a92c10e995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c94e7484-2d8f-43d7-ba40-32a92c10e995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbc7648-12c5-46cd-8a84-1c8dde5aa509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbc7648-12c5-46cd-8a84-1c8dde5aa509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a1740ce-2bdd-4890-bff1-84c214d0375f', 'volume_name': 'volume-8a1740ce-2bdd-4890-bff1-84c214d0375f', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0fbfc83-f21c-4b1e-abbf-c3fac1d18542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0fbfc83-f21c-4b1e-abbf-c3fac1d18542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562361e0-bd41-4b8e-bf58-dfa471f524ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:49 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume 8a1740ce-2bdd-4890-bff1-84c214d0375f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a1740ce-2bdd-4890-bff1-84c214d0375f', 'volume_size': 1} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1064732245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1740ce-2bdd-4890-bff1-84c214d0375f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54539fc8029b46c08a24d997cae66048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:49Z,use_quota=True,user_id='d2b6aec1c72a4628b76d80e5628126c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Creating volume 8a1740ce-2bdd-4890-bff1-84c214d0375f {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:49 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a1740ce-2bdd-4890-bff1-84c214d0375f 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:49 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a1740ce-2bdd-4890-bff1-84c214d0375f 1073741824 Jun 19 04:27:49 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Flow 'volume_create_manager' (048b7b29-3ff5-458a-b1ef-316050874184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0337700-acd0-4c4d-860a-7f5381dc4acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0337700-acd0-4c4d-860a-7f5381dc4acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-632113667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412a0a8f-9151-45d8-aaca-1de46d5ecd74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54539fc8029b46c08a24d997cae66048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:50Z,use_quota=True,user_id='d2b6aec1c72a4628b76d80e5628126c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b892aee-4f40-4b8e-ba5d-91373f00b691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b892aee-4f40-4b8e-ba5d-91373f00b691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b30d0b-756a-480f-a94d-a4e718ff9d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38b30d0b-756a-480f-a94d-a4e718ff9d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '412a0a8f-9151-45d8-aaca-1de46d5ecd74', 'volume_name': 'volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81fbca1-c531-4bb6-bba7-808e2387b6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81fbca1-c531-4bb6-bba7-808e2387b6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b53a65-54bf-4603-af48-f7895ff48d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:49 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume 412a0a8f-9151-45d8-aaca-1de46d5ecd74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74', 'volume_size': 1} Jun 19 04:27:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:50 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Flow 'volume_create_manager' (6225c50a-43e2-4625-80fe-534b563989c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2aff3c-61cb-4770-b9b1-2afe53c66e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb2aff3c-61cb-4770-b9b1-2afe53c66e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-384542577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6806e5-9a24-43f7-90a7-283a10035ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54539fc8029b46c08a24d997cae66048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:50Z,use_quota=True,user_id='d2b6aec1c72a4628b76d80e5628126c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667abbb3-2218-4c30-9377-5adac6a6f862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (667abbb3-2218-4c30-9377-5adac6a6f862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67933564-295b-43e4-b6b6-b3228c94dc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67933564-295b-43e4-b6b6-b3228c94dc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a6806e5-9a24-43f7-90a7-283a10035ccb', 'volume_name': 'volume-9a6806e5-9a24-43f7-90a7-283a10035ccb', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4f7161-6ebc-4f3d-ae55-4c705831458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4f7161-6ebc-4f3d-ae55-4c705831458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be926797-db79-4709-91c0-7cec2aad897e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:50 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume 9a6806e5-9a24-43f7-90a7-283a10035ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a6806e5-9a24-43f7-90a7-283a10035ccb', 'volume_size': 1} Jun 19 04:27:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:50 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a1740ce-2bdd-4890-bff1-84c214d0375f 1073741824" returned: 0 in 1.930s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a1740ce-2bdd-4890-bff1-84c214d0375f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:51 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a1740ce-2bdd-4890-bff1-84c214d0375f Jun 19 04:27:51 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:51 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Flow 'volume_create_manager' (3616fef8-a74e-48b5-b3b3-f171fd6c281b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048cbb9a-417e-4744-acc3-ba565fad8e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048cbb9a-417e-4744-acc3-ba565fad8e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1044283481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54539fc8029b46c08a24d997cae66048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:51Z,use_quota=True,user_id='d2b6aec1c72a4628b76d80e5628126c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403746d3-fc36-460c-9895-71be91d79143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403746d3-fc36-460c-9895-71be91d79143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e73936-12cb-48ae-9a5a-6489cd0a8222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e73936-12cb-48ae-9a5a-6489cd0a8222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65', 'volume_name': 'volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9f9723-781b-4374-bce2-918994aa49fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9f9723-781b-4374-bce2-918994aa49fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4a2de9-5839-48cb-8421-3dbd8d9cb632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:51 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume 3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65', 'volume_size': 1} Jun 19 04:27:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Flow 'volume_create_manager' (671ca350-6a98-4177-a09d-720f7637bf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca58ea8-5b12-43be-b8af-3ff8108d6227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aca58ea8-5b12-43be-b8af-3ff8108d6227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1706938801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9863d9d-0cb3-4333-a915-5a1e69809ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54539fc8029b46c08a24d997cae66048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:52Z,use_quota=True,user_id='d2b6aec1c72a4628b76d80e5628126c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12315144-5e61-449f-8c5b-60d919cb7477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12315144-5e61-449f-8c5b-60d919cb7477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7077568a-15b3-40ba-a347-d9b49efd0896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7077568a-15b3-40ba-a347-d9b49efd0896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9863d9d-0cb3-4333-a915-5a1e69809ac3', 'volume_name': 'volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d86926c-084a-407c-85e7-f6abd74acf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d86926c-084a-407c-85e7-f6abd74acf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6bf64d-8e05-4cbf-99f2-c560b4e99a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume e9863d9d-0cb3-4333-a915-5a1e69809ac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3', 'volume_size': 1} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:52 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a1740ce-2bdd-4890-bff1-84c214d0375f" returned: 0 in 1.720s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] <== create_volume: return (3715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.721s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.897s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-632113667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412a0a8f-9151-45d8-aaca-1de46d5ecd74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54539fc8029b46c08a24d997cae66048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:50Z,use_quota=True,user_id='d2b6aec1c72a4628b76d80e5628126c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Creating volume 412a0a8f-9151-45d8-aaca-1de46d5ecd74 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:52 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562361e0-bd41-4b8e-bf58-dfa471f524ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a1740ce-2bdd-4890-bff1-84c214d0375f', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:52 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74 1073741824 Jun 19 04:27:52 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb001df-888e-4b87-833b-76150a955899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume volume-8a1740ce-2bdd-4890-bff1-84c214d0375f (8a1740ce-2bdd-4890-bff1-84c214d0375f): created successfully Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb001df-888e-4b87-833b-76150a955899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Flow 'volume_create_manager' (7a04bc0d-fbae-46bd-a93a-0508e4cca9f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:52 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d7c1607c-76b7-46fb-9250-73256286a521 tempest-CreateVolumesFromSnapshotTest-170809816 None] Created volume successfully. Jun 19 04:27:54 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74 1073741824" returned: 0 in 1.615s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:54 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74 Jun 19 04:27:54 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:55 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74" returned: 0 in 1.250s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] <== create_volume: return (2966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.969s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.160s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-384542577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6806e5-9a24-43f7-90a7-283a10035ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54539fc8029b46c08a24d997cae66048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:50Z,use_quota=True,user_id='d2b6aec1c72a4628b76d80e5628126c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Creating volume 9a6806e5-9a24-43f7-90a7-283a10035ccb {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:55 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9a6806e5-9a24-43f7-90a7-283a10035ccb 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b53a65-54bf-4603-af48-f7895ff48d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:55 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9a6806e5-9a24-43f7-90a7-283a10035ccb 1073741824 Jun 19 04:27:55 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff8af46-ddff-4db9-82b7-8712a6398db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:55 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74 (412a0a8f-9151-45d8-aaca-1de46d5ecd74): created successfully Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff8af46-ddff-4db9-82b7-8712a6398db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Flow 'volume_create_manager' (048b7b29-3ff5-458a-b1ef-316050874184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:55 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-5157db68-8688-43dc-909d-856a3f450f0d tempest-CreateVolumesFromSnapshotTest-170809816 None] Created volume successfully. Jun 19 04:27:57 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9a6806e5-9a24-43f7-90a7-283a10035ccb 1073741824" returned: 0 in 1.307s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9a6806e5-9a24-43f7-90a7-283a10035ccb {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:57 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9a6806e5-9a24-43f7-90a7-283a10035ccb Jun 19 04:27:57 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:58 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9a6806e5-9a24-43f7-90a7-283a10035ccb" returned: 0 in 0.973s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] <== create_volume: return (2341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.346s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.704s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1044283481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54539fc8029b46c08a24d997cae66048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:51Z,use_quota=True,user_id='d2b6aec1c72a4628b76d80e5628126c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Creating volume 3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:58 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be926797-db79-4709-91c0-7cec2aad897e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a6806e5-9a24-43f7-90a7-283a10035ccb', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486f5eab-f970-4612-a64f-55584768cb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:58 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65 1073741824 Jun 19 04:27:58 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:58 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume volume-9a6806e5-9a24-43f7-90a7-283a10035ccb (9a6806e5-9a24-43f7-90a7-283a10035ccb): created successfully Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (486f5eab-f970-4612-a64f-55584768cb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Flow 'volume_create_manager' (6225c50a-43e2-4625-80fe-534b563989c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:58 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-5970ff4e-570d-4cc9-827f-0b5490e8861e tempest-CreateVolumesFromSnapshotTest-170809816 None] Created volume successfully. Jun 19 04:27:58 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-0eb3ac35-d5f1-4908-a877-6c8cb7e73a83 tempest-GroupSnapshotsV319Test-1127002736 None] Group tempest-GroupSnapshotsV319Test-Group-1162754898: creating Jun 19 04:27:58 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-0eb3ac35-d5f1-4908-a877-6c8cb7e73a83 tempest-GroupSnapshotsV319Test-1127002736 None] Group tempest-GroupSnapshotsV319Test-Group-1162754898: created successfully Jun 19 04:27:58 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-0eb3ac35-d5f1-4908-a877-6c8cb7e73a83 tempest-GroupSnapshotsV319Test-1127002736 None] Create group completed successfully. Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:58 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:27:58 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:59 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65 1073741824" returned: 0 in 1.143s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:59 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65 Jun 19 04:27:59 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:59 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.758s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:27:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:27:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:28:00 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65" returned: 0 in 0.813s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.613s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1706938801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9863d9d-0cb3-4333-a915-5a1e69809ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54539fc8029b46c08a24d997cae66048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:52Z,use_quota=True,user_id='d2b6aec1c72a4628b76d80e5628126c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Creating volume e9863d9d-0cb3-4333-a915-5a1e69809ac3 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:00 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4a2de9-5839-48cb-8421-3dbd8d9cb632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b4a79e-4f76-4e76-8343-b0a412a83344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:00 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3 1073741824 Jun 19 04:28:00 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:00 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65 (3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65): created successfully Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b4a79e-4f76-4e76-8343-b0a412a83344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Flow 'volume_create_manager' (3616fef8-a74e-48b5-b3b3-f171fd6c281b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:00 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-b927f6d0-6f75-478f-8b6c-d119fb1b6d88 tempest-CreateVolumesFromSnapshotTest-170809816 None] Created volume successfully. Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Flow 'volume_create_manager' (ef744cc7-39ab-4e7a-a9aa-1e2b934a89d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cc28e4-c913-4f8e-afec-e26797f85a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cc28e4-c913-4f8e-afec-e26797f85a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1274116498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c85a0469-8ad8-4116-a507-eb5a28d7802e,host='devstack@QuobyteHD#QuobyteHD',id=7b9de58d-d809-4f40-bed3-a51a7e45f651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b91d42d5604824be1389c1467c148d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:01Z,use_quota=True,user_id='47173b778bea4493a1b7775fe6f93cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(195a4d74-9e42-4497-938b-1a129197f43a),volume_type_id=195a4d74-9e42-4497-938b-1a129197f43a)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d433b8a1-36ae-469e-bfa8-81dbbcf51c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d433b8a1-36ae-469e-bfa8-81dbbcf51c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3876b1-a8a6-4e0f-99b5-6a3d22f5122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb3876b1-a8a6-4e0f-99b5-6a3d22f5122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9de58d-d809-4f40-bed3-a51a7e45f651', 'volume_name': 'volume-7b9de58d-d809-4f40-bed3-a51a7e45f651', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310c68dd-f5f3-4fa1-aea5-9ad8fba3339c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310c68dd-f5f3-4fa1-aea5-9ad8fba3339c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf12880-4323-4156-87bc-7468f3eb286c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:00 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Volume 7b9de58d-d809-4f40-bed3-a51a7e45f651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9de58d-d809-4f40-bed3-a51a7e45f651', 'volume_size': 1} Jun 19 04:28:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-e82dfefe-d2cd-4eca-96a7-6daee491f5c6 req-05f12d64-927e-4a30-b204-165696f6f3b0 tempest-TestStampPattern-1492869148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:01 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3 1073741824" returned: 0 in 1.448s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:01 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3 Jun 19 04:28:01 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:02 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3" returned: 0 in 0.644s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] <== create_volume: return (2143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.367s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c85a0469-8ad8-4116-a507-eb5a28d7802e,created_at=2026-06-19T02:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1274116498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c85a0469-8ad8-4116-a507-eb5a28d7802e,host='devstack@QuobyteHD#QuobyteHD',id=7b9de58d-d809-4f40-bed3-a51a7e45f651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b91d42d5604824be1389c1467c148d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:01Z,use_quota=True,user_id='47173b778bea4493a1b7775fe6f93cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(195a4d74-9e42-4497-938b-1a129197f43a),volume_type_id=195a4d74-9e42-4497-938b-1a129197f43a)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Creating volume 7b9de58d-d809-4f40-bed3-a51a7e45f651 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:02 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6bf64d-8e05-4cbf-99f2-c560b4e99a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:02 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 1073741824 Jun 19 04:28:02 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2d53a3-eba0-42f1-80d2-904476aa3ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:02 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Volume volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3 (e9863d9d-0cb3-4333-a915-5a1e69809ac3): created successfully Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2d53a3-eba0-42f1-80d2-904476aa3ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Flow 'volume_create_manager' (671ca350-6a98-4177-a09d-720f7637bf74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:02 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-abff4cd3-91a3-4d11-b5fd-34562d400e0c tempest-CreateVolumesFromSnapshotTest-170809816 None] Created volume successfully. Jun 19 04:28:03 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 1073741824" returned: 0 in 0.881s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:03 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 Jun 19 04:28:03 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-e9863d9d-0cb3-4333-a915-5a1e69809ac3-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-e9863d9d-0cb3-4333-a915-5a1e69809ac3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-quobyte-e9863d9d-0cb3-4333-a915-5a1e69809ac3" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-e9863d9d-0cb3-4333-a915-5a1e69809ac3" acquired by "delete_volume" :: waited 0.025s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[096a1a90-7a30-455e-838e-7b3869813bf0]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:03 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3 Jun 19 04:28:03 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:03 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651" returned: 0 in 0.696s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-e82dfefe-d2cd-4eca-96a7-6daee491f5c6 req-05f12d64-927e-4a30-b204-165696f6f3b0 tempest-TestStampPattern-1492869148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.332s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf12880-4323-4156-87bc-7468f3eb286c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9de58d-d809-4f40-bed3-a51a7e45f651', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e169872-35fb-4682-b992-891c7a510cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc5114f-3379-4478-8816-b8d77f008f7e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-e82dfefe-d2cd-4eca-96a7-6daee491f5c6 req-05f12d64-927e-4a30-b204-165696f6f3b0 tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:03 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Volume volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 (7b9de58d-d809-4f40-bed3-a51a7e45f651): created successfully Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e169872-35fb-4682-b992-891c7a510cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Flow 'volume_create_manager' (ef744cc7-39ab-4e7a-a9aa-1e2b934a89d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:03 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-11baf3fd-3f96-420f-b459-5f888addd9f6 tempest-GroupSnapshotsV319Test-1127002736 None] Created volume successfully. Jun 19 04:28:04 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 Jun 19 04:28:04 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:04 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3" returned: 0 in 0.844s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:04 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3 Jun 19 04:28:04 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:04 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] GroupSnapshot 05a0e8fb-4ca2-4f2f-9e61-1292d7d1aa07: creating. Jun 19 04:28:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] Group snapshot 05a0e8fb-4ca2-4f2f-9e61-1292d7d1aa07: creating. {{(pid=93530) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 19 04:28:04 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-e82dfefe-d2cd-4eca-96a7-6daee491f5c6 req-05f12d64-927e-4a30-b204-165696f6f3b0 tempest-TestStampPattern-1492869148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3" returned: 0 in 0.938s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-e82dfefe-d2cd-4eca-96a7-6daee491f5c6 req-05f12d64-927e-4a30-b204-165696f6f3b0 tempest-TestStampPattern-1492869148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.970s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:04 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] Creating offline snapshot 8571c96a-f621-49fa-a36a-021fa0c5b4c7 of volume 7b9de58d-d809-4f40-bed3-a51a7e45f651 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:28:04 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[9796f9fb-4e25-4674-ab18-f546ce1ee102]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-e82dfefe-d2cd-4eca-96a7-6daee491f5c6 req-05f12d64-927e-4a30-b204-165696f6f3b0 tempest-TestStampPattern-1492869148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad60feb5-69db-4134-a260-2c6ecf540aa2', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:28:04 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-e82dfefe-d2cd-4eca-96a7-6daee491f5c6 req-05f12d64-927e-4a30-b204-165696f6f3b0 tempest-TestStampPattern-1492869148 None] attachment_update completed successfully. Jun 19 04:28:05 devstack sudo[108675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 Jun 19 04:28:05 devstack sudo[108675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:05 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-e9863d9d-0cb3-4333-a915-5a1e69809ac3" returned: 0 in 0.793s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:05 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-e9863d9d-0cb3-4333-a915-5a1e69809ac3" released by "delete_volume" :: held 1.693s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:05 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Created reservations ['ad06137b-bdd1-4eff-aed3-a16ec1ed3bad', '28d31bdc-b798-49ca-b3cf-1a32925a1667', 'c51d61f0-cd7c-4249-bf47-f7aa8b955cd6', 'dcd6ebc4-7349-439f-b005-dbd12fc4870f'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:05 devstack sudo[108678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:28:05 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:05 devstack sudo[108675]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651" returned: 0 in 0.957s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:05 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 1G Jun 19 04:28:05 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-quobyte-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:06 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac88d37-453d-4610-9e8d-52a44202e1eb]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:06 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65 Jun 19 04:28:06 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:06 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.992s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:06 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:06 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Deleted volume successfully. Jun 19 04:28:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2add9d2d-ef2b-46ba-8a58-bf18db96d09e tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-e9863d9d-0cb3-4333-a915-5a1e69809ac3-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:06 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65" returned: 0 in 0.832s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:07 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 1G" returned: 0 in 1.150s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:07 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65 Jun 19 04:28:07 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:07 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 Jun 19 04:28:07 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:07 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65" returned: 0 in 0.814s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:07 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65" released by "delete_volume" :: held 1.697s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:07 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7" returned: 0 in 0.857s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:07 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:28:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:07 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Created reservations ['b0bc64f8-6f00-4684-85a5-3c93d4ec0118', 'fad2bac5-7ff9-4108-924b-5234ed055a93', '80a783c3-9c7e-4ab2-a220-ee34cbc907f9', '127aa388-11e3-4c71-bac3-9b755c01e1bf'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:07 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 Jun 19 04:28:07 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:08 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:28:08 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-9a6806e5-9a24-43f7-90a7-283a10035ccb-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-9a6806e5-9a24-43f7-90a7-283a10035ccb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-quobyte-9a6806e5-9a24-43f7-90a7-283a10035ccb" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-9a6806e5-9a24-43f7-90a7-283a10035ccb" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de9b239-be80-4846-87b0-b7519f1257ef]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9a6806e5-9a24-43f7-90a7-283a10035ccb {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:08 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9a6806e5-9a24-43f7-90a7-283a10035ccb Jun 19 04:28:08 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:08 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7" returned: 0 in 0.875s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:08 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.830s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:08 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Deleted volume successfully. Jun 19 04:28:08 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.info Jun 19 04:28:08 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ab320b57-1d9e-4881-8789-c1e5cee9736d tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-3b17bd2c-8e8c-46ea-aa7c-22e4418e3c65-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:09 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9a6806e5-9a24-43f7-90a7-283a10035ccb" returned: 0 in 0.920s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9a6806e5-9a24-43f7-90a7-283a10035ccb {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:09 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9a6806e5-9a24-43f7-90a7-283a10035ccb Jun 19 04:28:09 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:09 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.info" returned: 0 in 0.749s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:09 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:28:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:09 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.info Jun 19 04:28:09 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:10 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9a6806e5-9a24-43f7-90a7-283a10035ccb" returned: 0 in 0.688s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-9a6806e5-9a24-43f7-90a7-283a10035ccb" released by "delete_volume" :: held 1.674s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:10 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.info" returned: 0 in 0.625s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.332s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Created reservations ['0e3ee02e-d9f2-40bf-afd2-b62236d230b8', 'e068f013-b117-44fb-bb51-d83bc16c74ce', '0a4f45ef-19af-4131-ba1a-cd8013c0175b', '4f3a0352-8819-43ae-a9b4-03bbd1d5002e'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:10 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a3b155c7-1bd2-4099-bac1-15e2a9bc4632 tempest-GroupSnapshotsV319Test-1127002736 None] group_snapshot 05a0e8fb-4ca2-4f2f-9e61-1292d7d1aa07: created successfully Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:10 devstack sudo[108830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:28:10 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-412a0a8f-9151-45d8-aaca-1de46d5ecd74-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-412a0a8f-9151-45d8-aaca-1de46d5ecd74-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-quobyte-412a0a8f-9151-45d8-aaca-1de46d5ecd74" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-412a0a8f-9151-45d8-aaca-1de46d5ecd74" acquired by "delete_volume" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[84313479-eeee-4bb0-a2b1-d9d19640fa79]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:10 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74 Jun 19 04:28:10 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:11 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.724s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:11 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:11 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Deleted volume successfully. Jun 19 04:28:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-73e32078-e07b-4ebb-937e-248b8666aac1 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-9a6806e5-9a24-43f7-90a7-283a10035ccb-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:11 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74" returned: 0 in 0.880s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:11 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74 Jun 19 04:28:11 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:11 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] group_snapshot 05a0e8fb-4ca2-4f2f-9e61-1292d7d1aa07: deleting Jun 19 04:28:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] group_snapshot 05a0e8fb-4ca2-4f2f-9e61-1292d7d1aa07: deleting {{(pid=93530) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 19 04:28:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Acquiring lock "cinder-quobyte-7b9de58d-d809-4f40-bed3-a51a7e45f651" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Lock "cinder-quobyte-7b9de58d-d809-4f40-bed3-a51a7e45f651" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Acquiring lock "cinder-quobyte-8571c96a-f621-49fa-a36a-021fa0c5b4c7" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Lock "cinder-quobyte-8571c96a-f621-49fa-a36a-021fa0c5b4c7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Deleting offline snapshot 8571c96a-f621-49fa-a36a-021fa0c5b4c7 of volume 7b9de58d-d809-4f40-bed3-a51a7e45f651 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:28:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] snapshot_file for this snap is: volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:28:11 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c59f8c0-a118-4f58-ac35-270ceee90c10]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:12 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 Jun 19 04:28:12 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:12 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-412a0a8f-9151-45d8-aaca-1de46d5ecd74" returned: 0 in 0.689s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-412a0a8f-9151-45d8-aaca-1de46d5ecd74" released by "delete_volume" :: held 1.622s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Created reservations ['576b85cf-eb59-4ae4-9f51-21926819419c', 'be32a9f5-2ce3-4d58-82b7-14755359954f', '4bd44020-4e37-4232-ae60-97c3b14dc14f', '7ceef503-807d-4f6c-9290-8bc593a4fdd8'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:12 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:28:12 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:12 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7" returned: 0 in 0.853s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b9de58d-d809-4f40-bed3-a51a7e45f651(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da2e947-7158-4d58-8974-b314946e1d00]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:12 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 Jun 19 04:28:12 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-8a1740ce-2bdd-4890-bff1-84c214d0375f-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-8a1740ce-2bdd-4890-bff1-84c214d0375f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-quobyte-8a1740ce-2bdd-4890-bff1-84c214d0375f" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:13 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-8a1740ce-2bdd-4890-bff1-84c214d0375f" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:13 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[a796a203-6158-4387-8e9c-5a8cd5bc6a24]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a1740ce-2bdd-4890-bff1-84c214d0375f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:13 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a1740ce-2bdd-4890-bff1-84c214d0375f Jun 19 04:28:13 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:13 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.794s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:13 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:13 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Deleted volume successfully. Jun 19 04:28:13 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3e2a3d2b-8856-4686-86d5-b356e26e23e5 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-412a0a8f-9151-45d8-aaca-1de46d5ecd74-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:13 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651" returned: 0 in 0.896s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:13 devstack sudo[108870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 Jun 19 04:28:13 devstack sudo[108870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:13 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a1740ce-2bdd-4890-bff1-84c214d0375f" returned: 0 in 0.802s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a1740ce-2bdd-4890-bff1-84c214d0375f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:13 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a1740ce-2bdd-4890-bff1-84c214d0375f Jun 19 04:28:13 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:14 devstack sudo[108870]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7" returned: 0 in 0.812s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:14 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8a1740ce-2bdd-4890-bff1-84c214d0375f" returned: 0 in 0.661s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:14 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7 Jun 19 04:28:14 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-8a1740ce-2bdd-4890-bff1-84c214d0375f" released by "delete_volume" :: held 1.515s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:14 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Created reservations ['7b84dec2-67bc-429f-8505-84be11ef441a', 'e5028e0d-621d-43c1-86c7-bf14773c527d', 'ecb91422-5816-40a9-8840-40f7c8ef3baa', 'f9082140-0800-4649-8827-737001b44730'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:14 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:14 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:14 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:28:14 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:14 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-faf6c47c-274e-44e9-ad90-559ba0ee3375 req-8955895f-4c59-43a5-aac5-9ff7e71e445e tempest-TestStampPattern-1492869148 None] Terminate volume connection completed successfully. Jun 19 04:28:14 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-faf6c47c-274e-44e9-ad90-559ba0ee3375 req-8955895f-4c59-43a5-aac5-9ff7e71e445e tempest-TestStampPattern-1492869148 None] Deleting attachment ad60feb5-69db-4134-a260-2c6ecf540aa2. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-83053369-a8a5-4bae-82e9-923b0726b716-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:15 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651.8571c96a-f621-49fa-a36a-021fa0c5b4c7" returned: 0 in 0.717s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-83053369-a8a5-4bae-82e9-923b0726b716-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-quobyte-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Lock "cinder-quobyte-8571c96a-f621-49fa-a36a-021fa0c5b4c7" released by "_delete_snapshot" :: held 3.416s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Lock "cinder-quobyte-7b9de58d-d809-4f40-bed3-a51a7e45f651" released by "delete_snapshot" :: held 3.450s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-quobyte-83053369-a8a5-4bae-82e9-923b0726b716" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-83053369-a8a5-4bae-82e9-923b0726b716" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Deleting offline snapshot 83053369-a8a5-4bae-82e9-923b0726b716 of volume 0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] snapshot_file for this snap is: volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d90327a-bd92-4f36-99a9-23c9c1c306fd]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:15 devstack cinder-volume[93530]: WARNING cinder.quota [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-541682424 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-541682424, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:28:15 devstack cinder-volume[93530]: WARNING cinder.quota [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-541682424 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-541682424, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:28:15 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.834s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Deleted volume successfully. Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] Created reservations ['537b3e21-23cc-4c3c-8cfd-933b49dd7c24', 'f73f2786-9b6c-4b0f-a75c-0c598dbae7b4', '4dab40b8-d6e9-497d-b77d-51d739832333', '93c0223d-ace9-4811-a657-528324f85825'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d42e49d7-1317-4ac8-9c8b-4a653932daa2 tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-8a1740ce-2bdd-4890-bff1-84c214d0375f-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:15 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 Jun 19 04:28:15 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-505ca209-7158-46a2-ab9b-fa958d2ced0a tempest-GroupSnapshotsV319Test-1127002736 None] group_snapshot 05a0e8fb-4ca2-4f2f-9e61-1292d7d1aa07: deleted successfully Jun 19 04:28:16 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716" returned: 0 in 0.842s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:28:16 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47ae12d-7a1c-42c0-965b-4e6f6975fa85]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:16 devstack sudo[108897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 Jun 19 04:28:16 devstack sudo[108897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Acquiring lock "cinder-quobyte-7b9de58d-d809-4f40-bed3-a51a7e45f651" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Lock "cinder-quobyte-7b9de58d-d809-4f40-bed3-a51a7e45f651" acquired by "delete_volume" :: waited 0.040s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:16 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffe592f-868c-42da-9993-432aae0e89bf]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:16 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 Jun 19 04:28:16 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] Creating offline snapshot aa4e111c-41fc-48ec-ab42-91fc34740ce9 of volume 33e21243-1b07-4ee0-b88f-d0cc8199e8d3 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:28:17 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[03863126-fca7-4d9f-970a-a841f9cb5015]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:17 devstack sudo[108904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 Jun 19 04:28:17 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:17 devstack sudo[108897]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1" returned: 0 in 0.901s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:17 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 Jun 19 04:28:17 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:17 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651" returned: 0 in 0.985s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:17 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651 Jun 19 04:28:17 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:17 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3" returned: 0 in 0.948s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:18 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 1G Jun 19 04:28:18 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:18 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716" returned: 0 in 0.934s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:18 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716 Jun 19 04:28:18 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:18 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-7b9de58d-d809-4f40-bed3-a51a7e45f651" returned: 0 in 0.718s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Lock "cinder-quobyte-7b9de58d-d809-4f40-bed3-a51a7e45f651" released by "delete_volume" :: held 1.768s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Created reservations ['4c26c898-47c0-454f-a1b0-a53277521fb5'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:18 devstack cinder-volume[93530]: WARNING cinder.quota [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-541682424 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-541682424, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Created reservations ['bfd37288-ed2e-421e-bf6f-3bf447c82983', '1885a046-803b-4271-aedc-de3b35cd1e5a', '6e76df78-367c-4fd8-b1d8-e411bb0ba222', '4bc87d75-9c4d-4bd7-b854-36eeea62fff8'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:18 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:28:18 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:18 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1.83053369-a8a5-4bae-82e9-923b0726b716" returned: 0 in 0.784s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:18 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 1G" returned: 0 in 0.983s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-83053369-a8a5-4bae-82e9-923b0726b716" released by "_delete_snapshot" :: held 3.652s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1" released by "delete_snapshot" :: held 3.698s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:19 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 Jun 19 04:28:19 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:19 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Created reservations ['eb749ee7-336b-4074-8ac2-014cb0ea4cc2', '8b3b592d-6860-432d-896f-8f7ab4901e89', 'd09e1e73-bef2-4e33-8d05-1abced499ebb', '0d603659-4a0f-458f-8181-d3d4bae148e4'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:19 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Delete snapshot completed successfully. Jun 19 04:28:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4cecf078-d916-496c-9a3f-21be209e06bb tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-83053369-a8a5-4bae-82e9-923b0726b716-delete_snapshot" released by "delete_snapshot" :: held 3.907s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:19 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "cinder-quobyte-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.949s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:19 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:19 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-861c9430-fb89-4b22-9f0f-61f6b9a1c7c5 tempest-GroupSnapshotsV319Test-1127002736 None] Delete group completed successfully. Jun 19 04:28:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1" acquired by "delete_volume" :: waited 0.029s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:19 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fbd9ee-0b53-40f4-b828-351b378ddb57]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:19 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 Jun 19 04:28:19 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:19 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9" returned: 0 in 0.881s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:19 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 is being set with open permissions: ugo+rw Jun 19 04:28:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:19 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 Jun 19 04:28:19 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:20 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9" returned: 0 in 0.943s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:20 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1" returned: 0 in 1.119s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:20 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1 Jun 19 04:28:20 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:20 devstack sudo[108995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.info Jun 19 04:28:20 devstack sudo[108995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:21 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1" returned: 0 in 0.890s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-quobyte-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1" released by "delete_volume" :: held 2.083s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:21 devstack sudo[108995]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:21 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Created reservations ['963e118a-60b9-4848-9154-28be2fb55193', 'b14d3ea4-b1ec-4d62-a187-453ffc4207b5', '9ad46247-84ba-4616-95d4-aa3ce235c710', 'ec42b53c-e68d-4bd6-9112-3ac4bb8224c5'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.info" returned: 0 in 0.938s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:21 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.info is being set with open permissions: ugo+rw Jun 19 04:28:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:21 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.info Jun 19 04:28:21 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:21 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:28:21 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:22 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.info" returned: 0 in 0.878s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.769s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:22 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=103,cinder:INSERT=34,cinder:UPDATE=120,cinder:DELETE=6 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:28:22 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:INSERT=34,cinder:UPDATE=123,cinder:SELECT=113,cinder:DELETE=11 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:28:22 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-68888160-2f06-441e-b038-e8eea357504b tempest-TestStampPattern-1492869148 None] Create snapshot completed successfully Jun 19 04:28:22 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.830s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:22 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:22 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Deleted volume successfully. Jun 19 04:28:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9a502526-1748-4a69-94e4-3dd52b336bbf tempest-CreateVolumesFromSnapshotTest-170809816 None] Lock "cinder-0e92ddca-a50b-4cbf-b618-a52e5bebd6a1-delete_volume" released by "delete_volume" :: held 3.259s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:25 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-7cc15869-c701-4ef6-b089-5a2428718220 req-3ef93ec2-098e-4a80-a49e-9de3a11f2677 tempest-TestShelveInstance-647203891 None] Terminate volume connection completed successfully. Jun 19 04:28:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-7cc15869-c701-4ef6-b089-5a2428718220 req-3ef93ec2-098e-4a80-a49e-9de3a11f2677 tempest-TestShelveInstance-647203891 None] Deleting attachment 3eb789ae-8b58-4f0e-bbeb-068798f077c1. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Flow 'volume_create_manager' (ef76613a-7b98-48d0-b492-0ca664a50361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd3cc88-a1dd-42c8-8147-1466035f216e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd3cc88-a1dd-42c8-8147-1466035f216e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f66fab-11cc-4995-aa0e-0aa5b5bf84d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbce0fde0cf84bd396ed250090f39a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:27Z,use_quota=True,user_id='1535594ab8754368971afe21b8d96e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3befab8-d972-4cda-9508-6459f63517e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3befab8-d972-4cda-9508-6459f63517e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d5f4d9-e362-4292-8f68-c183ac114b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6d5f4d9-e362-4292-8f68-c183ac114b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f66fab-11cc-4995-aa0e-0aa5b5bf84d2', 'volume_name': 'volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c634ba1-e9f2-48ba-983a-8523329fc967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c634ba1-e9f2-48ba-983a-8523329fc967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917a9dc3-3248-43b0-ac77-9ff6e6de3402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:27 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Volume 08f66fab-11cc-4995-aa0e-0aa5b5bf84d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2', 'volume_size': 1} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f66fab-11cc-4995-aa0e-0aa5b5bf84d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbce0fde0cf84bd396ed250090f39a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:27Z,use_quota=True,user_id='1535594ab8754368971afe21b8d96e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Creating volume 08f66fab-11cc-4995-aa0e-0aa5b5bf84d2 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:27 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:28:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:27 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2 1073741824 Jun 19 04:28:27 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:28 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2 1073741824" returned: 0 in 0.973s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:28 devstack sudo[109030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2 Jun 19 04:28:28 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:29 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2" returned: 0 in 1.019s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917a9dc3-3248-43b0-ac77-9ff6e6de3402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60080189-8f2a-4ae5-b11d-bcf591c4cae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:29 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Volume volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2 (08f66fab-11cc-4995-aa0e-0aa5b5bf84d2): created successfully Jun 19 04:28:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60080189-8f2a-4ae5-b11d-bcf591c4cae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Flow 'volume_create_manager' (ef76613a-7b98-48d0-b492-0ca664a50361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:29 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-30af96c6-347d-4658-a5c9-8efc1c2ff606 tempest-CinderUnicodeTest-1538705400 None] Created volume successfully. Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Flow 'volume_create_manager' (e452c2d3-48a4-4773-a9c0-aed4ec219489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15314d02-d62b-4fec-a773-4f5df05e3e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15314d02-d62b-4fec-a773-4f5df05e3e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1760940097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbce0fde0cf84bd396ed250090f39a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:31Z,use_quota=True,user_id='1535594ab8754368971afe21b8d96e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9718c7a5-2ed8-44ec-9ae4-3e8914813cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9718c7a5-2ed8-44ec-9ae4-3e8914813cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecfe6e3-cdd7-4ea8-a772-ecefb4e7a37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ecfe6e3-cdd7-4ea8-a772-ecefb4e7a37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392', 'volume_name': 'volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de20ad7-7858-4fc0-916a-2f17e1e9a7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de20ad7-7858-4fc0-916a-2f17e1e9a7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66810cdb-5f55-4aa2-9a1a-3033c79412cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:31 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Volume 89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392', 'volume_size': 1} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1760940097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbce0fde0cf84bd396ed250090f39a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:31Z,use_quota=True,user_id='1535594ab8754368971afe21b8d96e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Creating volume 89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:31 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:28:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:31 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 1073741824 Jun 19 04:28:31 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:32 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 1073741824" returned: 0 in 1.143s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:32 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 Jun 19 04:28:32 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-c8ce61d6-6772-40d1-b3e1-504b4ad365d1 req-bd25f18e-e441-42d0-ab8c-83533ab79efa tempest-TestShelveInstance-647203891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:32 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f3856224-cb3f-432f-b958-162bcdc61aec tempest-GroupsV314Test-1574085700 None] Group tempest-GroupsV314Test-Group-2031627098: creating Jun 19 04:28:32 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f3856224-cb3f-432f-b958-162bcdc61aec tempest-GroupsV314Test-1574085700 None] Group tempest-GroupsV314Test-Group-2031627098: created successfully Jun 19 04:28:32 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f3856224-cb3f-432f-b958-162bcdc61aec tempest-GroupsV314Test-1574085700 None] Create group completed successfully. Jun 19 04:28:33 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392" returned: 0 in 0.860s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:33 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-c8ce61d6-6772-40d1-b3e1-504b4ad365d1 req-bd25f18e-e441-42d0-ab8c-83533ab79efa tempest-TestShelveInstance-647203891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.565s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:33 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66810cdb-5f55-4aa2-9a1a-3033c79412cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:33 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620e6662-b17b-433c-8f38-9638b2732785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:33 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Volume volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 (89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392): created successfully Jun 19 04:28:33 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620e6662-b17b-433c-8f38-9638b2732785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:33 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Flow 'volume_create_manager' (e452c2d3-48a4-4773-a9c0-aed4ec219489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:33 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[41209177-4d0d-4ea5-984a-19518ee2281e]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-c8ce61d6-6772-40d1-b3e1-504b4ad365d1 req-bd25f18e-e441-42d0-ab8c-83533ab79efa tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:33 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-261ca4e5-20a5-498d-ac17-1049bab89ac8 tempest-CinderUnicodeTest-1538705400 None] Created volume successfully. Jun 19 04:28:33 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 Jun 19 04:28:33 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:34 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-c8ce61d6-6772-40d1-b3e1-504b4ad365d1 req-bd25f18e-e441-42d0-ab8c-83533ab79efa tempest-TestShelveInstance-647203891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5" returned: 0 in 0.824s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-c8ce61d6-6772-40d1-b3e1-504b4ad365d1 req-bd25f18e-e441-42d0-ab8c-83533ab79efa tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:34 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 Jun 19 04:28:34 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:34 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:28:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Flow 'volume_create_manager' (1e55d3d5-44e2-4839-a9ca-9e07b318793a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ab841c-4c29-4bbe-ac6a-14882c132089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ab841c-4c29-4bbe-ac6a-14882c132089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-352454646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cb34331-5de4-4dbf-ad15-2fb98db55ba9,host='devstack@QuobyteHD#QuobyteHD',id=71676054-80ef-41dd-87ff-7857e5393684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3f6ebfaef54ad982d5604b2ffd4fad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:34Z,use_quota=True,user_id='f11f80590c964039825cee5596c99f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16f689f2-bebf-419c-bef2-f449158891a2),volume_type_id=16f689f2-bebf-419c-bef2-f449158891a2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a458ae6-2666-475a-81eb-131a0a098e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a458ae6-2666-475a-81eb-131a0a098e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03ade85-4b1f-4960-b983-0afe5caab7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03ade85-4b1f-4960-b983-0afe5caab7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71676054-80ef-41dd-87ff-7857e5393684', 'volume_name': 'volume-71676054-80ef-41dd-87ff-7857e5393684', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0315c88e-345a-419f-9230-df2cfd179622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0315c88e-345a-419f-9230-df2cfd179622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a0cc82-4b1c-4c6a-81a2-75030b87dbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:34 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Volume 71676054-80ef-41dd-87ff-7857e5393684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71676054-80ef-41dd-87ff-7857e5393684', 'volume_size': 1} Jun 19 04:28:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:35 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-c8ce61d6-6772-40d1-b3e1-504b4ad365d1 req-bd25f18e-e441-42d0-ab8c-83533ab79efa tempest-TestShelveInstance-647203891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5" returned: 1 in 0.834s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-c8ce61d6-6772-40d1-b3e1-504b4ad365d1 req-bd25f18e-e441-42d0-ab8c-83533ab79efa tempest-TestShelveInstance-647203891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-c8ce61d6-6772-40d1-b3e1-504b4ad365d1 req-bd25f18e-e441-42d0-ab8c-83533ab79efa tempest-TestShelveInstance-647203891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.762s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3cb34331-5de4-4dbf-ad15-2fb98db55ba9,created_at=2026-06-19T02:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-352454646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3cb34331-5de4-4dbf-ad15-2fb98db55ba9,host='devstack@QuobyteHD#QuobyteHD',id=71676054-80ef-41dd-87ff-7857e5393684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3f6ebfaef54ad982d5604b2ffd4fad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:34Z,use_quota=True,user_id='f11f80590c964039825cee5596c99f35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16f689f2-bebf-419c-bef2-f449158891a2),volume_type_id=16f689f2-bebf-419c-bef2-f449158891a2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Creating volume 71676054-80ef-41dd-87ff-7857e5393684 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:35 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:35 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 1073741824 Jun 19 04:28:35 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-c8ce61d6-6772-40d1-b3e1-504b4ad365d1 req-bd25f18e-e441-42d0-ab8c-83533ab79efa tempest-TestShelveInstance-647203891 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33b23fc9-5bb1-4174-a3ff-98b305ece03c', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:28:35 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-c8ce61d6-6772-40d1-b3e1-504b4ad365d1 req-bd25f18e-e441-42d0-ab8c-83533ab79efa tempest-TestShelveInstance-647203891 None] attachment_update completed successfully. Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Flow 'volume_create_manager' (87e2e580-1899-4c94-9100-195848b94af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d5e6be-4135-44d8-9d3b-7caa164238fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79d5e6be-4135-44d8-9d3b-7caa164238fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-600060717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68583013-862d-417e-910c-443e235cc51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c05e9f0b8c1a4b91a7c551ed7cc545e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aa4e111c-41fc-48ec-ab42-91fc34740ce9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:35Z,use_quota=True,user_id='3c0fc27e60e1429ba04e57ecd0c860b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ef8a0c-826a-419c-9663-c2431e575423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ef8a0c-826a-419c-9663-c2431e575423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46ecd76-464a-4408-8bd5-8b6df1ecd9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46ecd76-464a-4408-8bd5-8b6df1ecd9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68583013-862d-417e-910c-443e235cc51b', 'volume_name': 'volume-68583013-862d-417e-910c-443e235cc51b', 'volume_size': 1, 'snapshot_id': 'aa4e111c-41fc-48ec-ab42-91fc34740ce9'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320b32a0-1c63-49ab-812b-bc53723aa20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320b32a0-1c63-49ab-812b-bc53723aa20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9d9d82-7eec-467d-bec4-902e5b443d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:35 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Volume 68583013-862d-417e-910c-443e235cc51b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68583013-862d-417e-910c-443e235cc51b', 'volume_size': 1, 'snapshot_id': 'aa4e111c-41fc-48ec-ab42-91fc34740ce9'} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:36 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 1073741824" returned: 0 in 1.088s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:36 devstack sudo[109112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 Jun 19 04:28:36 devstack sudo[109112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:36 devstack sudo[109112]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684" returned: 0 in 0.741s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.470s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Acquiring lock "cinder-quobyte-aa4e111c-41fc-48ec-ab42-91fc34740ce9-68583013-862d-417e-910c-443e235cc51b" by "_create_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a0cc82-4b1c-4c6a-81a2-75030b87dbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71676054-80ef-41dd-87ff-7857e5393684', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d032e5-adae-4db7-a870-4d461830e797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Lock "cinder-quobyte-aa4e111c-41fc-48ec-ab42-91fc34740ce9-68583013-862d-417e-910c-443e235cc51b" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Creating volume 68583013-862d-417e-910c-443e235cc51b from snapshot aa4e111c-41fc-48ec-ab42-91fc34740ce9 {{(pid=93530) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Acquiring lock "cinder-quobyte-68583013-862d-417e-910c-443e235cc51b" by "_copy_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:37 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Volume volume-71676054-80ef-41dd-87ff-7857e5393684 (71676054-80ef-41dd-87ff-7857e5393684): created successfully Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d032e5-adae-4db7-a870-4d461830e797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Flow 'volume_create_manager' (1e55d3d5-44e2-4839-a9ca-9e07b318793a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Lock "cinder-quobyte-68583013-862d-417e-910c-443e235cc51b" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] snapshot: aa4e111c-41fc-48ec-ab42-91fc34740ce9, volume: 68583013-862d-417e-910c-443e235cc51b, {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:28:37 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-92ad8d8f-fd0e-44cb-9f61-06fe03768054 tempest-GroupsV314Test-1574085700 None] Created volume successfully. Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05bc540-52e9-4d84-a116-f34dc0bd7965]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:37 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 Jun 19 04:28:37 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:37 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9" returned: 0 in 0.779s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Creating direct copy from snapshot {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70f4a94-3e5b-4bc2-b934-1fcabee86f7f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:38 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 Jun 19 04:28:38 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:38 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3" returned: 0 in 0.868s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:38 devstack cinder-volume[93530]: DEBUG cinder.utils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Path /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b not found in is_blk_device check {{(pid=93530) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:28:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:38 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b Jun 19 04:28:38 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:44 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b" returned: 0 in 5.834s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:44 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9258f94-f0ce-4b5a-b18c-6880b78daa6f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:44 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 Jun 19 04:28:44 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:46 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3" returned: 0 in 1.413s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:46 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Image conversion details: src /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:28:46 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Converted 1024.00 MB image at 175.48 MB/s Jun 19 04:28:46 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b is being set with open permissions: ugo+rw Jun 19 04:28:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:46 devstack sudo[109246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b Jun 19 04:28:46 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:46 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b" returned: 0 in 0.870s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Lock "cinder-quobyte-68583013-862d-417e-910c-443e235cc51b" released by "_copy_volume_from_snapshot" :: held 9.908s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Lock "cinder-quobyte-aa4e111c-41fc-48ec-ab42-91fc34740ce9-68583013-862d-417e-910c-443e235cc51b" released by "_create_volume_from_snapshot" :: held 9.960s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.003s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.448s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] Creating offline snapshot 18fcddbb-2cdc-4c03-b794-16cdbd5ddabf of volume 89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:28:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9d9d82-7eec-467d-bec4-902e5b443d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68583013-862d-417e-910c-443e235cc51b', 'volume_size': 1, 'snapshot_id': 'aa4e111c-41fc-48ec-ab42-91fc34740ce9'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41984b69-6637-4b94-9798-e7306c8f0a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:47 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[31da5b9b-ca98-46ff-b5e7-c96435521396]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:47 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Volume volume-68583013-862d-417e-910c-443e235cc51b (68583013-862d-417e-910c-443e235cc51b): created successfully Jun 19 04:28:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41984b69-6637-4b94-9798-e7306c8f0a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Flow 'volume_create_manager' (87e2e580-1899-4c94-9100-195848b94af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:47 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-58340c9c-6ed8-494e-89bd-f269b2f36b0a tempest-TestStampPattern-1492869148 None] Created volume successfully. Jun 19 04:28:47 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 Jun 19 04:28:47 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:47 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392" returned: 0 in 0.866s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:47 devstack sudo[109271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf 1G Jun 19 04:28:47 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:48 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf 1G" returned: 0 in 0.942s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:48 devstack sudo[109608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf Jun 19 04:28:48 devstack sudo[109608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:49 devstack sudo[109608]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf" returned: 0 in 0.870s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:49 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf is being set with open permissions: ugo+rw Jun 19 04:28:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:49 devstack sudo[109643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf Jun 19 04:28:49 devstack sudo[109643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:50 devstack sudo[109643]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf" returned: 0 in 1.098s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:50 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.info Jun 19 04:28:50 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:51 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.info" returned: 0 in 0.659s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:51 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.info is being set with open permissions: ugo+rw Jun 19 04:28:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:51 devstack sudo[109706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.info Jun 19 04:28:51 devstack sudo[109706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:52 devstack sudo[109706]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.info" returned: 0 in 0.833s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.409s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 13.003s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:52 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Cloning volume 71676054-80ef-41dd-87ff-7857e5393684 to volume 5070f33a-ab5b-46b1-bc3a-c5004d3486a8 Jun 19 04:28:52 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e58a6083-8303-417e-ab47-497c272fe3a2 tempest-CinderUnicodeTest-1538705400 None] Create snapshot completed successfully Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Creating offline snapshot 260708ef-bee5-412e-93a1-4e4ece967093 of volume 71676054-80ef-41dd-87ff-7857e5393684 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd9cda4-5d65-4553-9e41-22297354b573]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:52 devstack sudo[109719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 Jun 19 04:28:52 devstack sudo[109719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Acquiring lock "cinder-18fcddbb-2cdc-4c03-b794-16cdbd5ddabf-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Lock "cinder-18fcddbb-2cdc-4c03-b794-16cdbd5ddabf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Acquiring lock "cinder-quobyte-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Lock "cinder-quobyte-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Acquiring lock "cinder-quobyte-18fcddbb-2cdc-4c03-b794-16cdbd5ddabf" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Lock "cinder-quobyte-18fcddbb-2cdc-4c03-b794-16cdbd5ddabf" acquired by "_delete_snapshot" :: waited 0.102s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Deleting offline snapshot 18fcddbb-2cdc-4c03-b794-16cdbd5ddabf of volume 89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] snapshot_file for this snap is: volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5cb740-b280-469b-9794-1fccf7bc525e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:53 devstack sudo[109741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf Jun 19 04:28:53 devstack sudo[109741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:54 devstack sudo[109719]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684" returned: 0 in 1.776s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:54 devstack sudo[109767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 1G Jun 19 04:28:54 devstack sudo[109767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:54 devstack sudo[109741]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf" returned: 0 in 1.763s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:28:54 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[881fd607-dcd5-4799-a270-08415cd70dc5]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:54 devstack sudo[109776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 Jun 19 04:28:54 devstack sudo[109776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:55 devstack sudo[109767]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 1G" returned: 0 in 1.499s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71676054-80ef-41dd-87ff-7857e5393684 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:55 devstack sudo[109782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71676054-80ef-41dd-87ff-7857e5393684 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 Jun 19 04:28:55 devstack sudo[109782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:56 devstack sudo[109776]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392" returned: 0 in 1.339s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:56 devstack sudo[109787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf Jun 19 04:28:56 devstack sudo[109787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:57 devstack sudo[109782]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71676054-80ef-41dd-87ff-7857e5393684 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093" returned: 0 in 1.310s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:57 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:28:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:57 devstack sudo[109797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 Jun 19 04:28:57 devstack sudo[109797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:57 devstack sudo[109787]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf" returned: 0 in 1.011s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:57 devstack sudo[109799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf Jun 19 04:28:57 devstack sudo[109799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:58 devstack sudo[109797]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093" returned: 0 in 1.342s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:58 devstack sudo[109799]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392.18fcddbb-2cdc-4c03-b794-16cdbd5ddabf" returned: 0 in 1.386s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:58 devstack sudo[109803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.info Jun 19 04:28:58 devstack sudo[109803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Lock "cinder-quobyte-18fcddbb-2cdc-4c03-b794-16cdbd5ddabf" released by "_delete_snapshot" :: held 5.788s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Lock "cinder-quobyte-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392" released by "delete_snapshot" :: held 5.905s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:58 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Created reservations ['0bee23e9-7138-4abf-95a0-1666a16d46dd', '99363a6f-426e-4505-91e3-0e8eb41d9502', '567d1674-1791-4330-ae8b-cce85d929f0a', 'f26e726b-5525-4e16-a884-29b40e460813'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:58 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Delete snapshot completed successfully. Jun 19 04:28:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-87a53648-5504-4ec0-b340-d1490438d2d6 tempest-CinderUnicodeTest-1538705400 None] Lock "cinder-18fcddbb-2cdc-4c03-b794-16cdbd5ddabf-delete_snapshot" released by "delete_snapshot" :: held 6.239s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:28:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:59 devstack sudo[109805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:28:59 devstack sudo[109805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Acquiring lock "cinder-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Lock "cinder-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Acquiring lock "cinder-quobyte-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Lock "cinder-quobyte-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392" acquired by "delete_volume" :: waited 0.042s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:59 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e2b81c-8069-4a06-af77-57d0bbec8aea]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:59 devstack sudo[109803]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.info" returned: 0 in 1.239s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:59 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:28:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:59 devstack sudo[109810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.info Jun 19 04:28:59 devstack sudo[109810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:59 devstack sudo[109809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 Jun 19 04:28:59 devstack sudo[109809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:00 devstack sudo[109805]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.643s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:00 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:29:00 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:29:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:29:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:29:01 devstack sudo[109809]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392" returned: 0 in 1.838s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:01 devstack sudo[109834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392 Jun 19 04:29:01 devstack sudo[109834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:01 devstack sudo[109810]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.info" returned: 0 in 1.910s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Acquiring lock "cinder-quobyte-5070f33a-ab5b-46b1-bc3a-c5004d3486a8" by "_copy_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Lock "cinder-quobyte-5070f33a-ab5b-46b1-bc3a-c5004d3486a8" acquired by "_copy_volume_from_snapshot" :: waited 0.105s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] snapshot: 260708ef-bee5-412e-93a1-4e4ece967093, volume: 5070f33a-ab5b-46b1-bc3a-c5004d3486a8, {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:29:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:01 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[92462910-7f5f-4602-b7ae-a63408b34487]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:02 devstack sudo[109837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 Jun 19 04:29:02 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:02 devstack sudo[109834]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392" returned: 0 in 1.058s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Lock "cinder-quobyte-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392" released by "delete_volume" :: held 3.053s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:02 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Created reservations ['5098e1b1-07f4-40c3-a27f-4a0d4e613e15', 'f72eb0d2-8c04-4ff2-a7b8-ba357e811bcd', '52bc2ac4-6e60-4191-954e-82003b331a93', 'be6d6acd-21e1-4aa8-adcf-85cbdbf13220'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:29:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:02 devstack sudo[109841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:29:02 devstack sudo[109841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Acquiring lock "cinder-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Lock "cinder-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Acquiring lock "cinder-quobyte-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:03 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Lock "cinder-quobyte-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2" acquired by "delete_volume" :: waited 0.050s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:03 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d9cca4-9ddf-4a25-824f-59b0eb11013b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:03 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093" returned: 0 in 1.850s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71676054-80ef-41dd-87ff-7857e5393684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:29:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:29:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Creating direct copy from snapshot {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:29:03 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91d2edb-9821-4134-901a-1139147d3db0]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:03 devstack sudo[109846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2 Jun 19 04:29:03 devstack sudo[109846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:04 devstack sudo[109847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 Jun 19 04:29:04 devstack sudo[109847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:04 devstack sudo[109841]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.384s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:04 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:29:04 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Deleted volume successfully. Jun 19 04:29:04 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a4b89e40-a5d8-486d-82a4-95370ca563e7 tempest-CinderUnicodeTest-1538705400 None] Lock "cinder-89a7f7c4-60a3-4bfb-95a9-4ba1b2d6f392-delete_volume" released by "delete_volume" :: held 4.845s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:05 devstack sudo[109847]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684" returned: 0 in 1.239s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:05 devstack cinder-volume[93530]: DEBUG cinder.utils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Path /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8 not found in is_blk_device check {{(pid=93530) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:29:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:05 devstack sudo[109857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8 Jun 19 04:29:05 devstack sudo[109857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:05 devstack sudo[109846]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2" returned: 0 in 1.696s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:05 devstack sudo[109860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2 Jun 19 04:29:05 devstack sudo[109860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:07 devstack sudo[109860]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2" returned: 0 in 1.827s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:07 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Lock "cinder-quobyte-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2" released by "delete_volume" :: held 3.644s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:07 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Created reservations ['4d907069-a3cc-4a3c-adfb-1b80ebebfa8a', 'df519523-1408-4b09-843d-6cfc7a6ffdc9', '73b1b311-2fb2-42fa-aacf-e70d650648d6', '1ac79239-b21a-48e9-aef0-97d4cea47315'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:29:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:08 devstack sudo[109899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:29:08 devstack sudo[109899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:11 devstack sudo[109899]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 3.371s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:11 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:29:11 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Deleted volume successfully. Jun 19 04:29:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9835018e-36ff-484d-8ca5-532c61a4a223 tempest-CinderUnicodeTest-1538705400 None] Lock "cinder-08f66fab-11cc-4995-aa0e-0aa5b5bf84d2-delete_volume" released by "delete_volume" :: held 8.031s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:13 devstack sudo[109857]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8" returned: 0 in 8.317s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:13 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[096c598e-207d-4390-a8e4-14086391597b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:13 devstack sudo[109929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 Jun 19 04:29:13 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:14 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684" returned: 0 in 0.992s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:14 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Image conversion details: src /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684, size 1024.00 MB, duration 8.32 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:29:14 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Converted 1024.00 MB image at 123.11 MB/s Jun 19 04:29:14 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:29:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:14 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8 Jun 19 04:29:14 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:15 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8" returned: 0 in 0.702s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Lock "cinder-quobyte-5070f33a-ab5b-46b1-bc3a-c5004d3486a8" released by "_copy_volume_from_snapshot" :: held 13.280s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Acquiring lock "cinder-quobyte-260708ef-bee5-412e-93a1-4e4ece967093" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Lock "cinder-quobyte-260708ef-bee5-412e-93a1-4e4ece967093" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Deleting offline snapshot 260708ef-bee5-412e-93a1-4e4ece967093 of volume 71676054-80ef-41dd-87ff-7857e5393684 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:29:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] snapshot_file for this snap is: volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:29:15 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebf80a9-089b-4c5c-ab4e-ab3265ddd20f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:15 devstack sudo[109938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 Jun 19 04:29:15 devstack sudo[109938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:15 devstack sudo[109938]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093" returned: 0 in 0.748s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71676054-80ef-41dd-87ff-7857e5393684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:29:15 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca2006a-33d5-4f29-a00d-91437614b2e9]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:16 devstack sudo[109943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 Jun 19 04:29:16 devstack sudo[109943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:16 devstack sudo[109943]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684" returned: 0 in 0.732s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:16 devstack sudo[109948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 Jun 19 04:29:16 devstack sudo[109948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:17 devstack sudo[109948]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093" returned: 0 in 0.726s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:17 devstack sudo[109953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093 Jun 19 04:29:17 devstack sudo[109953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:17 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:DELETE=5,cinder:SELECT=38,cinder:UPDATE=37,cinder:INSERT=9 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:29:17 devstack sudo[109953]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684.260708ef-bee5-412e-93a1-4e4ece967093" returned: 0 in 0.621s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Lock "cinder-quobyte-260708ef-bee5-412e-93a1-4e4ece967093" released by "_delete_snapshot" :: held 2.922s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 25.682s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:18 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-9e3cdb76-9e2f-4a2b-8832-3c17a10befbd tempest-GroupsV314Test-1574085700 None] Create group from source-group-3cb34331-5de4-4dbf-ad15-2fb98db55ba9 completed successfully. Jun 19 04:29:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Acquiring lock "cinder-quobyte-5070f33a-ab5b-46b1-bc3a-c5004d3486a8" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Lock "cinder-quobyte-5070f33a-ab5b-46b1-bc3a-c5004d3486a8" acquired by "delete_volume" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:19 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ee94ac-c8d6-4677-b478-e88679a4b8dc]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:19 devstack sudo[109957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8 Jun 19 04:29:19 devstack sudo[109957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:20 devstack sudo[109957]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8" returned: 0 in 0.809s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:20 devstack sudo[109962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8 Jun 19 04:29:20 devstack sudo[109962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:20 devstack sudo[109962]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5070f33a-ab5b-46b1-bc3a-c5004d3486a8" returned: 0 in 0.657s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Lock "cinder-quobyte-5070f33a-ab5b-46b1-bc3a-c5004d3486a8" released by "delete_volume" :: held 1.512s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:21 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Created reservations ['50607a7e-6b35-4722-acb0-b7fda055ea90'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:29:21 devstack cinder-volume[93530]: WARNING cinder.quota [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1152938578 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1152938578, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:29:21 devstack cinder-volume[93530]: WARNING cinder.quota [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1152938578 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1152938578, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:29:21 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Created reservations ['4753c49a-8148-40d5-8a35-f1a48a98dfb8', 'da5e5fea-8402-421a-89fa-bfb073390934', 'b909e53b-09f8-40bc-9a9e-e48bc0371a1f', '49cb8378-5930-40bb-9f70-66dcbce2d677'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:29:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:21 devstack sudo[109966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:29:21 devstack sudo[109966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:21 devstack sudo[109966]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.613s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:21 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:29:21 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-4eaeac95-459d-4f10-989a-1a1b38ee64b8 tempest-GroupsV314Test-1574085700 None] Delete group completed successfully. Jun 19 04:29:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Acquiring lock "cinder-quobyte-71676054-80ef-41dd-87ff-7857e5393684" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Lock "cinder-quobyte-71676054-80ef-41dd-87ff-7857e5393684" acquired by "delete_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:22 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[39316114-babc-4ce7-b21a-c179350b99a5]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:22 devstack sudo[109969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 Jun 19 04:29:22 devstack sudo[109969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:22 devstack sudo[109969]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684" returned: 0 in 0.797s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:22 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684 Jun 19 04:29:22 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:23 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-71676054-80ef-41dd-87ff-7857e5393684" returned: 0 in 0.674s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Lock "cinder-quobyte-71676054-80ef-41dd-87ff-7857e5393684" released by "delete_volume" :: held 1.537s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:23 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=54,cinder:UPDATE=52,cinder:DELETE=4,cinder:INSERT=12 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:29:23 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Created reservations ['fd5a4c21-9b4c-4013-aaae-ea5dc51231b7'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:29:23 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Created reservations ['5d6de95d-f826-4aeb-ad9c-045f80ec8fc8', 'd3bf6278-75e7-4c9e-ae79-45ef0fcc24fe', 'a79c9ef6-bcd2-4ca8-959f-119b3b8e4fb5', '154fdccb-30a7-4719-b761-2a2e1d205be7'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:29:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:23 devstack sudo[109980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:29:23 devstack sudo[109980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:24 devstack sudo[109980]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.627s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:24 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:29:24 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-40ae37a9-3704-4ce5-a811-f7dc91c03b1b tempest-GroupsV314Test-1574085700 None] Delete group completed successfully. Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Flow 'volume_create_manager' (8b3bb5e8-b39d-46e7-a6d5-a6b1eb047b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c2404d-2530-414a-8e9f-c2d806403f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9c2404d-2530-414a-8e9f-c2d806403f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-999617799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b790717-ad1a-4373-9385-f94cd80d854b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa9cc8d29c45b89ec4b7439c940edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:30Z,use_quota=True,user_id='451096ec7b144ba6bce7d69137cd60e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084a8d24-e4fb-498c-b642-52db9bb6e472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084a8d24-e4fb-498c-b642-52db9bb6e472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489e7a49-0421-4bdc-9984-ce4078ccd096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489e7a49-0421-4bdc-9984-ce4078ccd096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b790717-ad1a-4373-9385-f94cd80d854b', 'volume_name': 'volume-4b790717-ad1a-4373-9385-f94cd80d854b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb5d623-dfab-4ddf-8530-7574ce17681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb5d623-dfab-4ddf-8530-7574ce17681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d7651d-22af-4295-a18a-44e7d239ab9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:29 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Volume 4b790717-ad1a-4373-9385-f94cd80d854b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b790717-ad1a-4373-9385-f94cd80d854b', 'volume_size': 1} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-999617799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b790717-ad1a-4373-9385-f94cd80d854b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dfa9cc8d29c45b89ec4b7439c940edb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:30Z,use_quota=True,user_id='451096ec7b144ba6bce7d69137cd60e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Creating volume 4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:29:29 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:29:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:29 devstack sudo[109992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b 1073741824 Jun 19 04:29:29 devstack sudo[109992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:30 devstack sudo[109992]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b 1073741824" returned: 0 in 0.948s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:30 devstack sudo[110037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b Jun 19 04:29:30 devstack sudo[110037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:31 devstack sudo[110037]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b" returned: 0 in 0.681s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:29:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d7651d-22af-4295-a18a-44e7d239ab9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b790717-ad1a-4373-9385-f94cd80d854b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba411db5-83dd-497b-945f-2ec340555fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:31 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Volume volume-4b790717-ad1a-4373-9385-f94cd80d854b (4b790717-ad1a-4373-9385-f94cd80d854b): created successfully Jun 19 04:29:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba411db5-83dd-497b-945f-2ec340555fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Flow 'volume_create_manager' (8b3bb5e8-b39d-46e7-a6d5-a6b1eb047b31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:31 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-22f57e86-11b2-458c-85d2-f8b86cc63868 tempest-SnapshotsActionsTest-257737403 None] Created volume successfully. Jun 19 04:29:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] Creating offline snapshot f571931f-2de3-40ee-8c9d-93d6fe56d806 of volume 4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:29:31 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b17bca-8bf5-48a6-9678-addd6ac5a5f6]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:32 devstack sudo[110044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b Jun 19 04:29:32 devstack sudo[110044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:32 devstack sudo[110044]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b" returned: 0 in 0.843s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:32 devstack sudo[110050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 1G Jun 19 04:29:32 devstack sudo[110050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:33 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-08b6a050-4498-4cb2-85bb-f195c674b8c1 tempest-TestShelveInstance-647203891 None] Terminate volume connection completed successfully. Jun 19 04:29:33 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-08b6a050-4498-4cb2-85bb-f195c674b8c1 tempest-TestShelveInstance-647203891 None] Deleting attachment 33b23fc9-5bb1-4174-a3ff-98b305ece03c. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:29:33 devstack sudo[110050]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 1G" returned: 0 in 0.863s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:33 devstack sudo[110055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 Jun 19 04:29:33 devstack sudo[110055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:33 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Acquiring lock "cinder-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:33 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Lock "cinder-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:33 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Acquiring lock "cinder-quobyte-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:33 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Lock "cinder-quobyte-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:34 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf802857-75d8-4206-9e40-e9c6c43e5cdd]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:34 devstack sudo[110057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 Jun 19 04:29:34 devstack sudo[110057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:34 devstack sudo[110055]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806" returned: 0 in 0.701s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:34 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 is being set with open permissions: ugo+rw Jun 19 04:29:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:34 devstack sudo[110062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 Jun 19 04:29:34 devstack sudo[110062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:34 devstack sudo[110057]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5" returned: 0 in 0.797s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:34 devstack sudo[110066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 Jun 19 04:29:34 devstack sudo[110066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:35 devstack sudo[110062]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806" returned: 0 in 0.713s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:35 devstack sudo[110069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.info Jun 19 04:29:35 devstack sudo[110069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:35 devstack sudo[110066]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5" returned: 1 in 0.747s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:29:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:35 devstack sudo[110074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5 Jun 19 04:29:35 devstack sudo[110074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:35 devstack sudo[110069]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.info" returned: 0 in 0.672s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:35 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.info is being set with open permissions: ugo+rw Jun 19 04:29:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:35 devstack sudo[110077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.info Jun 19 04:29:35 devstack sudo[110077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:36 devstack sudo[110074]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5" returned: 0 in 0.674s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Lock "cinder-quobyte-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5" released by "delete_volume" :: held 2.296s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:36 devstack cinder-volume[93530]: DEBUG cinder.quota [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Created reservations ['fa3367ee-b315-4b28-ba41-4ec12a5686ab', '56ac65c7-b71e-477c-9170-62732cf11696', '87ae5d9f-9976-4a88-bc45-d2c95b451fe6', '5adcb0db-d4a0-405c-8f66-5fd1f128705d'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:29:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:36 devstack sudo[110081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:29:36 devstack sudo[110081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:36 devstack sudo[110077]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.info" returned: 0 in 0.646s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.541s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:36 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-7ea2ba7a-446f-4364-b318-019a293be70d tempest-SnapshotsActionsTest-257737403 None] Create snapshot completed successfully Jun 19 04:29:37 devstack sudo[110081]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.653s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:37 devstack cinder-volume[93530]: DEBUG cinder.manager [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:29:37 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Deleted volume successfully. Jun 19 04:29:37 devstack cinder-volume[93530]: DEBUG cinder.coordination [req-df038880-5481-49b6-bdd4-ed035b3ab668 req-35cde0f8-495e-47f2-bd95-578c433b27ba tempest-TestShelveInstance-647203891 None] Lock "cinder-4ae5d5e0-8d86-4bb8-8b4e-3f881dfa99d5-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] Creating offline snapshot 3c5e55e4-c263-422e-be6c-ca7775a19bb8 of volume 4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:29:37 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[b681fd36-d94d-4f2d-bdee-b9944318a4f5]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:37 devstack sudo[110084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 Jun 19 04:29:37 devstack sudo[110084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:38 devstack sudo[110084]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806" returned: 0 in 0.844s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b790717-ad1a-4373-9385-f94cd80d854b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:29:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:38 devstack sudo[110093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 1G Jun 19 04:29:38 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:39 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 1G" returned: 0 in 0.871s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:39 devstack sudo[110103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 Jun 19 04:29:39 devstack sudo[110103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:40 devstack sudo[110103]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8" returned: 0 in 0.730s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:40 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 is being set with open permissions: ugo+rw Jun 19 04:29:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:40 devstack sudo[110108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 Jun 19 04:29:40 devstack sudo[110108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:41 devstack sudo[110108]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8" returned: 0 in 0.796s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.392s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:41 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f2ff8b67-8b87-47d7-bd0e-7fc85425b53c tempest-SnapshotsActionsTest-257737403 None] Create snapshot completed successfully Jun 19 04:29:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-3a1d6907-e72c-4054-8efb-4ee99df69f2a req-a5df4859-8b13-4327-9eab-c3856afad3a4 tempest-TestStampPattern-1492869148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-3a1d6907-e72c-4054-8efb-4ee99df69f2a req-a5df4859-8b13-4327-9eab-c3856afad3a4 tempest-TestStampPattern-1492869148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:41 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[37911772-16ca-4491-b34a-a3b6e11a94c7]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-3a1d6907-e72c-4054-8efb-4ee99df69f2a req-a5df4859-8b13-4327-9eab-c3856afad3a4 tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:41 devstack sudo[110121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b Jun 19 04:29:41 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Acquiring lock "cinder-3c5e55e4-c263-422e-be6c-ca7775a19bb8-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-3c5e55e4-c263-422e-be6c-ca7775a19bb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Acquiring lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Acquiring lock "cinder-quobyte-3c5e55e4-c263-422e-be6c-ca7775a19bb8" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-3c5e55e4-c263-422e-be6c-ca7775a19bb8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:42 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Deleting offline snapshot 3c5e55e4-c263-422e-be6c-ca7775a19bb8 of volume 4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:29:42 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] snapshot_file for this snap is: volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:29:42 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[887a5a16-92ae-494d-9bd8-fdc9f8503d26]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:42 devstack sudo[110123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 Jun 19 04:29:42 devstack sudo[110123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:42 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-3a1d6907-e72c-4054-8efb-4ee99df69f2a req-a5df4859-8b13-4327-9eab-c3856afad3a4 tempest-TestStampPattern-1492869148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b" returned: 0 in 0.880s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-3a1d6907-e72c-4054-8efb-4ee99df69f2a req-a5df4859-8b13-4327-9eab-c3856afad3a4 tempest-TestStampPattern-1492869148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.907s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:42 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-3a1d6907-e72c-4054-8efb-4ee99df69f2a req-a5df4859-8b13-4327-9eab-c3856afad3a4 tempest-TestStampPattern-1492869148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-68583013-862d-417e-910c-443e235cc51b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb16eecf-8938-43a0-9fd3-33d60430a78b', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:29:42 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-3a1d6907-e72c-4054-8efb-4ee99df69f2a req-a5df4859-8b13-4327-9eab-c3856afad3a4 tempest-TestStampPattern-1492869148 None] attachment_update completed successfully. Jun 19 04:29:43 devstack sudo[110123]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8" returned: 0 in 0.806s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b790717-ad1a-4373-9385-f94cd80d854b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:29:43 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd88c54-48a9-4a4f-96e2-6fcdb73f441e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:43 devstack sudo[110131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 Jun 19 04:29:43 devstack sudo[110131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:43 devstack sudo[110131]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806" returned: 0 in 0.923s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b790717-ad1a-4373-9385-f94cd80d854b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:29:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:43 devstack sudo[110204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 Jun 19 04:29:43 devstack sudo[110204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:44 devstack sudo[110204]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8" returned: 0 in 0.885s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:44 devstack sudo[110527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8 Jun 19 04:29:44 devstack sudo[110527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:45 devstack sudo[110527]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.3c5e55e4-c263-422e-be6c-ca7775a19bb8" returned: 0 in 0.961s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-3c5e55e4-c263-422e-be6c-ca7775a19bb8" released by "_delete_snapshot" :: held 3.709s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" released by "delete_snapshot" :: held 3.740s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:45 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Created reservations ['7741c31b-b19b-4a33-9411-a79905fcda78', 'ff59758f-c9d0-4aea-9a6d-3a728b4cb898', '479e368d-8bbc-4ab7-9cbb-3e9122595fc0', '2f84bbe4-b9c3-47e1-95e7-fbf53e054de2'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:29:46 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Delete snapshot completed successfully. Jun 19 04:29:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0a555239-e3ad-43c8-bd4f-64e15391682f tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-3c5e55e4-c263-422e-be6c-ca7775a19bb8-delete_snapshot" released by "delete_snapshot" :: held 3.925s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] Creating offline snapshot f477724c-a786-4327-b30b-408c92b4ab99 of volume 4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:29:46 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[543f1cb3-06d4-48ff-9ec6-f190a6bf3e67]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:47 devstack sudo[110567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 Jun 19 04:29:47 devstack sudo[110567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:47 devstack sudo[110567]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806" returned: 0 in 0.856s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b790717-ad1a-4373-9385-f94cd80d854b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:29:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:47 devstack sudo[110574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 1G Jun 19 04:29:47 devstack sudo[110574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:48 devstack sudo[110574]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 1G" returned: 0 in 1.011s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:48 devstack sudo[110597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 Jun 19 04:29:48 devstack sudo[110597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:49 devstack sudo[110597]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99" returned: 0 in 0.789s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:49 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 is being set with open permissions: ugo+rw Jun 19 04:29:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:49 devstack sudo[110602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 Jun 19 04:29:49 devstack sudo[110602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:50 devstack sudo[110602]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99" returned: 0 in 0.772s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.564s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:50 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-3819905e-65b7-40e6-819b-f3a9112a5930 tempest-SnapshotsActionsTest-257737403 None] Create snapshot completed successfully Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Flow 'volume_create_manager' (b52b8a6c-0a6b-4a40-9724-0d8f15d31159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd86f876-ffd0-43fc-b0a2-729d48afe3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd86f876-ffd0-43fc-b0a2-729d48afe3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1307816753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e5ac58-9bfa-4de4-83a6-baeba6dbab37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c583ad3f177746639dd3973182577d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:50Z,use_quota=True,user_id='5ab912fa9a3845839e2983ec6eb7b1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec2a140-604b-4577-a54c-729dbaab599f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ec2a140-604b-4577-a54c-729dbaab599f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461d1f66-eb4c-424f-aa60-7262f2b45adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461d1f66-eb4c-424f-aa60-7262f2b45adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e5ac58-9bfa-4de4-83a6-baeba6dbab37', 'volume_name': 'volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36637fc-bd82-46bb-b2d6-17f6dca40b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36637fc-bd82-46bb-b2d6-17f6dca40b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60108467-6f3d-4d0f-ae27-198fa65ac2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:50 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Volume 34e5ac58-9bfa-4de4-83a6-baeba6dbab37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37', 'volume_size': 1} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1307816753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e5ac58-9bfa-4de4-83a6-baeba6dbab37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c583ad3f177746639dd3973182577d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:50Z,use_quota=True,user_id='5ab912fa9a3845839e2983ec6eb7b1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Creating volume 34e5ac58-9bfa-4de4-83a6-baeba6dbab37 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:29:50 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:50 devstack sudo[110636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 1073741824 Jun 19 04:29:50 devstack sudo[110636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:50 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-900687db-89ed-42e0-a839-8e35ee6582d6 req-74b8fef4-0055-4ce1-8460-a07343392180 tempest-TestStampPattern-1492869148 None] Terminate volume connection completed successfully. Jun 19 04:29:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-900687db-89ed-42e0-a839-8e35ee6582d6 req-74b8fef4-0055-4ce1-8460-a07343392180 tempest-TestStampPattern-1492869148 None] Deleting attachment eb16eecf-8938-43a0-9fd3-33d60430a78b. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:29:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Acquiring lock "cinder-f477724c-a786-4327-b30b-408c92b4ab99-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-f477724c-a786-4327-b30b-408c92b4ab99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Acquiring lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Acquiring lock "cinder-quobyte-f477724c-a786-4327-b30b-408c92b4ab99" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:51 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-f477724c-a786-4327-b30b-408c92b4ab99" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Deleting offline snapshot f477724c-a786-4327-b30b-408c92b4ab99 of volume 4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:29:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] snapshot_file for this snap is: volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:29:51 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df64062-9b4a-4e68-b6c4-7881f2acabde]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:51 devstack sudo[110642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 Jun 19 04:29:51 devstack sudo[110642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:51 devstack sudo[110636]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 1073741824" returned: 0 in 0.920s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:51 devstack sudo[110645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 Jun 19 04:29:51 devstack sudo[110645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:52 devstack sudo[110642]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99" returned: 0 in 0.800s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b790717-ad1a-4373-9385-f94cd80d854b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[3108cee9-fd8f-4c62-bc8e-9780dffff6e5]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:52 devstack sudo[110650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 Jun 19 04:29:52 devstack sudo[110650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:52 devstack sudo[110645]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37" returned: 0 in 0.751s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60108467-6f3d-4d0f-ae27-198fa65ac2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ad3100-d259-492d-94ef-e725e8d215cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:52 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Volume volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 (34e5ac58-9bfa-4de4-83a6-baeba6dbab37): created successfully Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ad3100-d259-492d-94ef-e725e8d215cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Flow 'volume_create_manager' (b52b8a6c-0a6b-4a40-9724-0d8f15d31159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:52 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-8ad1c80a-9eec-426b-a5cd-fbe1831acb80 tempest-VolumeDependencyTests-606433676 None] Created volume successfully. Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] Creating offline snapshot b80c40c0-13f2-40ed-9134-ad8e297d7d4f of volume 34e5ac58-9bfa-4de4-83a6-baeba6dbab37 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[6738e89e-0300-40e1-81a5-ca5ce40bc4d6]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:52 devstack sudo[110655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 Jun 19 04:29:52 devstack sudo[110655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:52 devstack sudo[110650]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806" returned: 0 in 0.913s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b790717-ad1a-4373-9385-f94cd80d854b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:29:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:53 devstack sudo[110658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 Jun 19 04:29:53 devstack sudo[110658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:53 devstack sudo[110655]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37" returned: 0 in 0.935s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:53 devstack sudo[110668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f 1G Jun 19 04:29:53 devstack sudo[110668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:53 devstack sudo[110658]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99" returned: 0 in 0.977s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:53 devstack sudo[110671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99 Jun 19 04:29:54 devstack sudo[110671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:54 devstack sudo[110668]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f 1G" returned: 0 in 0.887s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:54 devstack sudo[110688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f Jun 19 04:29:54 devstack sudo[110688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:54 devstack sudo[110671]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f477724c-a786-4327-b30b-408c92b4ab99" returned: 0 in 0.873s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-f477724c-a786-4327-b30b-408c92b4ab99" released by "_delete_snapshot" :: held 3.715s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" released by "delete_snapshot" :: held 3.752s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:55 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Created reservations ['89db8156-f16d-4593-86be-c5fc152d07a5', '709d6f2e-8d6c-4bac-8977-ec3ec1cb321c', '54124b32-489e-4bef-9926-02abce83474b', 'e2e715b0-581c-41d1-9520-496d207df6c8'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:29:55 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Delete snapshot completed successfully. Jun 19 04:29:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3556620f-4e11-4e8a-b6d6-11c399e7150b tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-f477724c-a786-4327-b30b-408c92b4ab99-delete_snapshot" released by "delete_snapshot" :: held 3.980s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:55 devstack sudo[110688]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f" returned: 0 in 0.940s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:55 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f is being set with open permissions: ugo+rw Jun 19 04:29:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:55 devstack sudo[110722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f Jun 19 04:29:55 devstack sudo[110722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:56 devstack sudo[110722]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f" returned: 0 in 0.676s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:56 devstack sudo[110726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.info Jun 19 04:29:56 devstack sudo[110726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:56 devstack sudo[110726]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.info" returned: 0 in 0.675s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:56 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.info is being set with open permissions: ugo+rw Jun 19 04:29:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:56 devstack sudo[110730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.info Jun 19 04:29:56 devstack sudo[110730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:57 devstack sudo[110730]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.info" returned: 0 in 0.639s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.840s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.861s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] Creating offline snapshot 44f8e05c-2237-4eae-b3c5-cb3465cc6698 of volume 4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:29:57 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-61439d44-53ab-4eac-bc11-46c90aa10786 tempest-VolumeDependencyTests-606433676 None] Create snapshot completed successfully Jun 19 04:29:57 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[394bf060-f915-4ff0-90fb-335981366f6f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:57 devstack sudo[110733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 Jun 19 04:29:57 devstack sudo[110733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:58 devstack sudo[110733]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806" returned: 0 in 0.793s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b790717-ad1a-4373-9385-f94cd80d854b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:58 devstack sudo[110738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 1G Jun 19 04:29:58 devstack sudo[110738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Flow 'volume_create_manager' (dc0e3e04-22e3-41fb-adaf-541c7279c0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1bac770-4f87-4ba8-8e61-16089960cda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1bac770-4f87-4ba8-8e61-16089960cda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1196201014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3efcfe0-44c8-4131-9de2-e8d80f322417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c583ad3f177746639dd3973182577d45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b80c40c0-13f2-40ed-9134-ad8e297d7d4f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:58Z,use_quota=True,user_id='5ab912fa9a3845839e2983ec6eb7b1cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b72dab6-b17b-4f3f-a63d-901884c7b245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b72dab6-b17b-4f3f-a63d-901884c7b245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d255ad2-55c6-494e-a821-04fdc618d3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d255ad2-55c6-494e-a821-04fdc618d3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd3efcfe0-44c8-4131-9de2-e8d80f322417', 'volume_name': 'volume-d3efcfe0-44c8-4131-9de2-e8d80f322417', 'volume_size': 1, 'snapshot_id': 'b80c40c0-13f2-40ed-9134-ad8e297d7d4f'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff3e3ab-028b-4834-a2b4-56132611ffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff3e3ab-028b-4834-a2b4-56132611ffb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b291bf39-14ed-413c-8237-38297dc5a651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:58 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Volume d3efcfe0-44c8-4131-9de2-e8d80f322417: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d3efcfe0-44c8-4131-9de2-e8d80f322417', 'volume_size': 1, 'snapshot_id': 'b80c40c0-13f2-40ed-9134-ad8e297d7d4f'} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:58 devstack sudo[110740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:29:58 devstack sudo[110740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:59 devstack sudo[110738]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 1G" returned: 0 in 0.857s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:59 devstack sudo[110745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 Jun 19 04:29:59 devstack sudo[110745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:59 devstack sudo[110740]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.666s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:29:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:29:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:29:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:30:00 devstack sudo[110745]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698" returned: 0 in 0.679s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:00 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 is being set with open permissions: ugo+rw Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Acquiring lock "cinder-68583013-862d-417e-910c-443e235cc51b-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:00 devstack sudo[110751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 Jun 19 04:30:00 devstack sudo[110751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Lock "cinder-68583013-862d-417e-910c-443e235cc51b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Acquiring lock "cinder-quobyte-68583013-862d-417e-910c-443e235cc51b" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Lock "cinder-quobyte-68583013-862d-417e-910c-443e235cc51b" acquired by "delete_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ac6842-11a2-478b-b8ed-e0b62422447c]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:00 devstack sudo[110753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b Jun 19 04:30:00 devstack sudo[110753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:00 devstack sudo[110751]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698" returned: 0 in 0.672s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.133s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.096s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Acquiring lock "cinder-quobyte-b80c40c0-13f2-40ed-9134-ad8e297d7d4f-d3efcfe0-44c8-4131-9de2-e8d80f322417" by "_create_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Lock "cinder-quobyte-b80c40c0-13f2-40ed-9134-ad8e297d7d4f-d3efcfe0-44c8-4131-9de2-e8d80f322417" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Creating volume d3efcfe0-44c8-4131-9de2-e8d80f322417 from snapshot b80c40c0-13f2-40ed-9134-ad8e297d7d4f {{(pid=93530) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Acquiring lock "cinder-quobyte-d3efcfe0-44c8-4131-9de2-e8d80f322417" by "_copy_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:00 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-12c1b8e3-f6b3-4028-948a-1ef6a56fada4 tempest-SnapshotsActionsTest-257737403 None] Create snapshot completed successfully Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Lock "cinder-quobyte-d3efcfe0-44c8-4131-9de2-e8d80f322417" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] snapshot: b80c40c0-13f2-40ed-9134-ad8e297d7d4f, volume: d3efcfe0-44c8-4131-9de2-e8d80f322417, {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace3c219-1df1-46c4-bdcc-3798f3ddcf12]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:00 devstack sudo[110759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f Jun 19 04:30:00 devstack sudo[110759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:00 devstack sudo[110753]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b" returned: 0 in 0.838s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:01 devstack sudo[110764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b Jun 19 04:30:01 devstack sudo[110764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Acquiring lock "cinder-44f8e05c-2237-4eae-b3c5-cb3465cc6698-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-44f8e05c-2237-4eae-b3c5-cb3465cc6698-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Acquiring lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Acquiring lock "cinder-quobyte-44f8e05c-2237-4eae-b3c5-cb3465cc6698" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-44f8e05c-2237-4eae-b3c5-cb3465cc6698" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Deleting offline snapshot 44f8e05c-2237-4eae-b3c5-cb3465cc6698 of volume 4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] snapshot_file for this snap is: volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d1bbfa-12ea-4e6b-a05e-60023dadd79c]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:01 devstack sudo[110767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 Jun 19 04:30:01 devstack sudo[110767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:01 devstack sudo[110759]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f" returned: 0 in 0.819s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Creating direct copy from snapshot {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda0e471-a7d3-4414-abc7-a672a826a9ee]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:01 devstack sudo[110764]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-68583013-862d-417e-910c-443e235cc51b" returned: 0 in 0.718s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Lock "cinder-quobyte-68583013-862d-417e-910c-443e235cc51b" released by "delete_volume" :: held 1.597s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Created reservations ['23a0b1d9-071f-426f-b8b6-280a57a2fbfa', '89e671c8-ab4c-4e99-8458-3b00a4f3970b', 'ed7fdab1-a7fe-4d53-80a0-396594cb747b', '101e2a89-70ba-4481-a634-6576b0d38df7'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:01 devstack sudo[110773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 Jun 19 04:30:01 devstack sudo[110773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:01 devstack sudo[110777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:30:01 devstack sudo[110777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:01 devstack sudo[110767]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698" returned: 0 in 0.801s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:01 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b790717-ad1a-4373-9385-f94cd80d854b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f83798f-8b7e-4f0d-8f34-4307431eac08]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:02 devstack sudo[110781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 Jun 19 04:30:02 devstack sudo[110781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:02 devstack sudo[110773]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37" returned: 0 in 0.886s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG cinder.utils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Path /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417 not found in is_blk_device check {{(pid=93530) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:02 devstack sudo[110794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417 Jun 19 04:30:02 devstack sudo[110794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Acquiring lock "cinder-aa4e111c-41fc-48ec-ab42-91fc34740ce9-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:02 devstack sudo[110777]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.857s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:02 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Deleted volume successfully. Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Lock "cinder-aa4e111c-41fc-48ec-ab42-91fc34740ce9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Acquiring lock "cinder-quobyte-33e21243-1b07-4ee0-b88f-d0cc8199e8d3" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Lock "cinder-quobyte-33e21243-1b07-4ee0-b88f-d0cc8199e8d3" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Acquiring lock "cinder-quobyte-aa4e111c-41fc-48ec-ab42-91fc34740ce9" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-25300ab3-d169-4b6f-ae29-8edb52e71749 tempest-TestStampPattern-1492869148 None] Lock "cinder-68583013-862d-417e-910c-443e235cc51b-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Lock "cinder-quobyte-aa4e111c-41fc-48ec-ab42-91fc34740ce9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Deleting offline snapshot aa4e111c-41fc-48ec-ab42-91fc34740ce9 of volume 33e21243-1b07-4ee0-b88f-d0cc8199e8d3 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] snapshot_file for this snap is: volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc38b434-2c51-4b5b-b64a-061df8dd19bf]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:02 devstack sudo[110781]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806" returned: 0 in 0.902s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b790717-ad1a-4373-9385-f94cd80d854b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:30:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:02 devstack sudo[110799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 Jun 19 04:30:02 devstack sudo[110799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:02 devstack sudo[110800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 Jun 19 04:30:02 devstack sudo[110800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:03 devstack sudo[110799]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9" returned: 0 in 1.079s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:30:03 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85d0b1c-8650-45b0-9779-3f624011de82]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:04 devstack sudo[110800]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698" returned: 0 in 1.097s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:04 devstack sudo[110820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698 Jun 19 04:30:04 devstack sudo[110820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:04 devstack sudo[110819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 Jun 19 04:30:04 devstack sudo[110819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:05 devstack sudo[110820]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.44f8e05c-2237-4eae-b3c5-cb3465cc6698" returned: 0 in 1.283s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:05 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-44f8e05c-2237-4eae-b3c5-cb3465cc6698" released by "_delete_snapshot" :: held 4.265s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:05 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" released by "delete_snapshot" :: held 4.308s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:05 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Created reservations ['7292e972-97c9-499d-8a9b-8c20c469e74b', '909da694-f591-49a1-a619-33d62f9c7b01', '2a554533-e129-49d9-a2fa-dce61527bc13', '08944228-8748-4883-96df-bde121ad06ba'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:05 devstack sudo[110819]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3" returned: 0 in 1.698s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:05 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Delete snapshot completed successfully. Jun 19 04:30:05 devstack sudo[110828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 Jun 19 04:30:05 devstack sudo[110828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:05 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-91f317b2-d947-4977-94f9-611c2d8af304 tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-44f8e05c-2237-4eae-b3c5-cb3465cc6698-delete_snapshot" released by "delete_snapshot" :: held 4.641s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:06 devstack sudo[110828]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9" returned: 0 in 1.324s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:07 devstack sudo[110834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9 Jun 19 04:30:07 devstack sudo[110834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:07 devstack sudo[110794]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417" returned: 0 in 5.405s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:07 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[343fc3f5-507b-45ed-bb32-301ecc13a5a2]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:08 devstack sudo[110834]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3.aa4e111c-41fc-48ec-ab42-91fc34740ce9" returned: 0 in 1.092s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:08 devstack sudo[110837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 Jun 19 04:30:08 devstack sudo[110837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Lock "cinder-quobyte-aa4e111c-41fc-48ec-ab42-91fc34740ce9" released by "_delete_snapshot" :: held 5.335s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Lock "cinder-quobyte-33e21243-1b07-4ee0-b88f-d0cc8199e8d3" released by "delete_snapshot" :: held 5.369s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:08 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Created reservations ['5e372f1a-a0c1-470d-988b-fe739d84eb5e', 'c6f279de-5902-4b2d-824d-6b77bccb1ee1', '7c5c70b7-42d6-41f3-b8eb-3976e5f229f7', 'eb7b036e-36f8-4d6f-ab7f-768625e8e584'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:08 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Delete snapshot completed successfully. Jun 19 04:30:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4b3ba668-80e6-454d-baba-d80bad71e648 tempest-TestStampPattern-1492869148 None] Lock "cinder-aa4e111c-41fc-48ec-ab42-91fc34740ce9-delete_snapshot" released by "delete_snapshot" :: held 5.526s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:08 devstack sudo[110837]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37" returned: 0 in 0.926s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:08 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Image conversion details: src /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:30:08 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Converted 1024.00 MB image at 189.43 MB/s Jun 19 04:30:08 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417 is being set with open permissions: ugo+rw Jun 19 04:30:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:08 devstack sudo[110842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417 Jun 19 04:30:08 devstack sudo[110842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:09 devstack sudo[110842]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417" returned: 0 in 0.633s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:09 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Lock "cinder-quobyte-d3efcfe0-44c8-4131-9de2-e8d80f322417" released by "_copy_volume_from_snapshot" :: held 8.766s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:09 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Lock "cinder-quobyte-b80c40c0-13f2-40ed-9134-ad8e297d7d4f-d3efcfe0-44c8-4131-9de2-e8d80f322417" released by "_create_volume_from_snapshot" :: held 8.811s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.841s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.422s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] Creating offline snapshot 0e65291d-1534-412c-905f-af6ebe9ef1ea of volume 4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:30:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b291bf39-14ed-413c-8237-38297dc5a651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3efcfe0-44c8-4131-9de2-e8d80f322417', 'volume_size': 1, 'snapshot_id': 'b80c40c0-13f2-40ed-9134-ad8e297d7d4f'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f64a9a7-c70d-4517-9abd-f66b4e99172a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:09 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d4ddc7-be78-49d2-8698-386e818c5614]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:09 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Volume volume-d3efcfe0-44c8-4131-9de2-e8d80f322417 (d3efcfe0-44c8-4131-9de2-e8d80f322417): created successfully Jun 19 04:30:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f64a9a7-c70d-4517-9abd-f66b4e99172a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Flow 'volume_create_manager' (dc0e3e04-22e3-41fb-adaf-541c7279c0cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:09 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-352d790b-260d-452b-b531-d3add5a34f0f tempest-VolumeDependencyTests-606433676 None] Created volume successfully. Jun 19 04:30:09 devstack sudo[110845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 Jun 19 04:30:09 devstack sudo[110845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:10 devstack sudo[110845]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806" returned: 0 in 0.845s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b790717-ad1a-4373-9385-f94cd80d854b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:30:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:10 devstack sudo[110856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea 1G Jun 19 04:30:10 devstack sudo[110856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Acquiring lock "cinder-b80c40c0-13f2-40ed-9134-ad8e297d7d4f-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Lock "cinder-b80c40c0-13f2-40ed-9134-ad8e297d7d4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Acquiring lock "cinder-quobyte-34e5ac58-9bfa-4de4-83a6-baeba6dbab37" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Lock "cinder-quobyte-34e5ac58-9bfa-4de4-83a6-baeba6dbab37" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Acquiring lock "cinder-quobyte-b80c40c0-13f2-40ed-9134-ad8e297d7d4f" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:10 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Lock "cinder-quobyte-b80c40c0-13f2-40ed-9134-ad8e297d7d4f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Deleting offline snapshot b80c40c0-13f2-40ed-9134-ad8e297d7d4f of volume 34e5ac58-9bfa-4de4-83a6-baeba6dbab37 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:30:10 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] snapshot_file for this snap is: volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:30:10 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[881dbfd1-d0bc-4acb-9fe7-a85707ee64f3]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:10 devstack sudo[110858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f Jun 19 04:30:10 devstack sudo[110858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:11 devstack sudo[110856]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:11 devstack sudo[110858]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea 1G" returned: 0 in 1.229s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f" returned: 0 in 1.032s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:30:11 devstack sudo[110910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea Jun 19 04:30:11 devstack sudo[110910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:11 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb433ad6-9162-42ef-a4fa-4e9582ec1ae7]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:11 devstack sudo[110912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 Jun 19 04:30:11 devstack sudo[110912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:12 devstack sudo[110910]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea" returned: 0 in 0.772s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:12 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea is being set with open permissions: ugo+rw Jun 19 04:30:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:12 devstack sudo[110919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea Jun 19 04:30:12 devstack sudo[110919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:12 devstack sudo[110912]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37" returned: 0 in 0.874s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:12 devstack sudo[110924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f Jun 19 04:30:12 devstack sudo[110924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea" returned: 0 in 0.704s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:13 devstack sudo[110919]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.696s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:13 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-678fa87d-ac27-4989-9e32-05b7df261775 tempest-SnapshotsActionsTest-257737403 None] Create snapshot completed successfully Jun 19 04:30:13 devstack sudo[110924]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f" returned: 0 in 0.831s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:13 devstack sudo[110931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f Jun 19 04:30:13 devstack sudo[110931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:14 devstack sudo[110931]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37.b80c40c0-13f2-40ed-9134-ad8e297d7d4f" returned: 0 in 0.633s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Lock "cinder-quobyte-b80c40c0-13f2-40ed-9134-ad8e297d7d4f" released by "_delete_snapshot" :: held 3.516s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Lock "cinder-quobyte-34e5ac58-9bfa-4de4-83a6-baeba6dbab37" released by "delete_snapshot" :: held 3.556s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Created reservations ['30f6d47c-f782-40f5-ad3f-99a54b2dcf31', '60af99f6-f12a-4629-9fb7-86f692ee908d', 'e37865a7-8e37-4739-9620-b18cd171ab60', '06d2ba78-541e-405a-b470-2ae3ee35ef7e'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:14 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Delete snapshot completed successfully. Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0774cb0f-33df-4121-9d31-476df8ac8255 tempest-VolumeDependencyTests-606433676 None] Lock "cinder-b80c40c0-13f2-40ed-9134-ad8e297d7d4f-delete_snapshot" released by "delete_snapshot" :: held 3.711s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Acquiring lock "cinder-0e65291d-1534-412c-905f-af6ebe9ef1ea-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-0e65291d-1534-412c-905f-af6ebe9ef1ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Acquiring lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Acquiring lock "cinder-quobyte-0e65291d-1534-412c-905f-af6ebe9ef1ea" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-0e65291d-1534-412c-905f-af6ebe9ef1ea" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Deleting offline snapshot 0e65291d-1534-412c-905f-af6ebe9ef1ea of volume 4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] snapshot_file for this snap is: volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[acaf4570-9365-4c49-8513-320b7ff4b9d5]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:14 devstack sudo[110934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea Jun 19 04:30:14 devstack sudo[110934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Acquiring lock "cinder-34e5ac58-9bfa-4de4-83a6-baeba6dbab37-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Lock "cinder-34e5ac58-9bfa-4de4-83a6-baeba6dbab37-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Acquiring lock "cinder-quobyte-34e5ac58-9bfa-4de4-83a6-baeba6dbab37" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Lock "cinder-quobyte-34e5ac58-9bfa-4de4-83a6-baeba6dbab37" acquired by "delete_volume" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:15 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ee5d25-b62e-4b73-9793-45862dc78849]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:15 devstack sudo[110936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 Jun 19 04:30:15 devstack sudo[110936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:15 devstack sudo[110934]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea" returned: 0 in 0.755s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b790717-ad1a-4373-9385-f94cd80d854b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:30:15 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbf0141-18aa-4729-9f85-113743e4ef14]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:15 devstack sudo[110941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 Jun 19 04:30:15 devstack sudo[110941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:15 devstack sudo[110936]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37" returned: 0 in 0.800s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:15 devstack sudo[110946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37 Jun 19 04:30:15 devstack sudo[110946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:16 devstack sudo[110941]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806" returned: 0 in 0.779s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b790717-ad1a-4373-9385-f94cd80d854b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:16 devstack sudo[110951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea Jun 19 04:30:16 devstack sudo[110951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:16 devstack sudo[110946]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-34e5ac58-9bfa-4de4-83a6-baeba6dbab37" returned: 0 in 0.664s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Lock "cinder-quobyte-34e5ac58-9bfa-4de4-83a6-baeba6dbab37" released by "delete_volume" :: held 1.533s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Created reservations ['77127903-ba76-42b2-be27-cd710320e7c2', 'f9480ebf-5e6e-427e-ae7d-7831bc1fc3a7', '44b8d8f5-f480-48a0-8e59-620bfe4ae160', '2da95232-863c-44b0-b8eb-ecf657e5d978'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Acquiring lock "cinder-33e21243-1b07-4ee0-b88f-d0cc8199e8d3-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Lock "cinder-33e21243-1b07-4ee0-b88f-d0cc8199e8d3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Acquiring lock "cinder-quobyte-33e21243-1b07-4ee0-b88f-d0cc8199e8d3" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:16 devstack sudo[110957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:30:16 devstack sudo[110957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Lock "cinder-quobyte-33e21243-1b07-4ee0-b88f-d0cc8199e8d3" acquired by "delete_volume" :: waited 0.015s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[be35eeb3-d62b-41ba-ae8d-fabaa86f74dc]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:17 devstack sudo[110951]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea" returned: 0 in 0.880s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:17 devstack sudo[110959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 Jun 19 04:30:17 devstack sudo[110959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:17 devstack sudo[110960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea Jun 19 04:30:17 devstack sudo[110960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Acquiring lock "cinder-d3efcfe0-44c8-4131-9de2-e8d80f322417-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Lock "cinder-d3efcfe0-44c8-4131-9de2-e8d80f322417-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Acquiring lock "cinder-quobyte-d3efcfe0-44c8-4131-9de2-e8d80f322417" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Lock "cinder-quobyte-d3efcfe0-44c8-4131-9de2-e8d80f322417" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7c9b2d-ace4-4185-b6d1-4c9747016634]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:17 devstack sudo[110963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417 Jun 19 04:30:17 devstack sudo[110963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:17 devstack sudo[110957]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.793s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:17 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Deleted volume successfully. Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7bc60af1-9e8a-4101-8e13-8e57a2401d89 tempest-VolumeDependencyTests-606433676 None] Lock "cinder-34e5ac58-9bfa-4de4-83a6-baeba6dbab37-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:17 devstack sudo[110960]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.0e65291d-1534-412c-905f-af6ebe9ef1ea" returned: 0 in 0.868s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:17 devstack sudo[110959]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3" returned: 0 in 1.000s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-0e65291d-1534-412c-905f-af6ebe9ef1ea" released by "_delete_snapshot" :: held 3.388s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" released by "delete_snapshot" :: held 3.415s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:17 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=99,cinder:SELECT=100,cinder:INSERT=25,cinder:DELETE=3 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:30:17 devstack sudo[110970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3 Jun 19 04:30:17 devstack sudo[110970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Created reservations ['b74bc5e1-46f3-4f3c-adf6-c12fe156e33e', '9dd1bb7f-6f93-4492-8bce-342a28741b75', '8d12d38a-67e9-4e6b-9155-0695c9928875', 'fcf453f3-4997-4871-bb6a-c15bf37a8a4e'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:18 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Delete snapshot completed successfully. Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3553db2c-d6ec-42b7-90ff-8b58e3fd6268 tempest-SnapshotsActionsTest-1936295213 None] Lock "cinder-0e65291d-1534-412c-905f-af6ebe9ef1ea-delete_snapshot" released by "delete_snapshot" :: held 3.582s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:18 devstack sudo[110963]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417" returned: 0 in 0.937s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:18 devstack sudo[110975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417 Jun 19 04:30:18 devstack sudo[110975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:18 devstack sudo[110970]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-33e21243-1b07-4ee0-b88f-d0cc8199e8d3" returned: 0 in 0.677s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Lock "cinder-quobyte-33e21243-1b07-4ee0-b88f-d0cc8199e8d3" released by "delete_volume" :: held 1.736s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Created reservations ['b064ce05-3639-414c-b152-9e5be669f805', 'f6b96b74-6476-40c7-bcfd-b80461f51497', '5829e94b-30c4-472e-856d-c54c81b32985', '71e0b816-04be-40b4-a9b5-b5cad66fd7f5'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:18 devstack sudo[110979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:30:18 devstack sudo[110979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:18 devstack sudo[110975]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d3efcfe0-44c8-4131-9de2-e8d80f322417" returned: 0 in 0.701s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Lock "cinder-quobyte-d3efcfe0-44c8-4131-9de2-e8d80f322417" released by "delete_volume" :: held 1.704s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Created reservations ['f0657dce-7db0-4170-bc65-85cd96743958', 'b1c9ab17-9a6f-4c93-82b7-edfc3dcefed9', 'b57372f5-c18e-4007-be7a-43cfdc6736fe', '603aac94-60e1-4a6a-aa2a-8f4533ad6ca0'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Acquiring lock "cinder-f571931f-2de3-40ee-8c9d-93d6fe56d806-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:19 devstack sudo[110982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:30:19 devstack sudo[110982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Lock "cinder-f571931f-2de3-40ee-8c9d-93d6fe56d806-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Acquiring lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Acquiring lock "cinder-quobyte-f571931f-2de3-40ee-8c9d-93d6fe56d806" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Lock "cinder-quobyte-f571931f-2de3-40ee-8c9d-93d6fe56d806" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Deleting offline snapshot f571931f-2de3-40ee-8c9d-93d6fe56d806 of volume 4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] snapshot_file for this snap is: volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[1296c588-3e70-4ed2-83bc-928eef301024]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:19 devstack sudo[110979]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.903s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:19 devstack sudo[110984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 Jun 19 04:30:19 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Deleted volume successfully. Jun 19 04:30:19 devstack sudo[110984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-93045a5b-79ca-432e-841d-d5137f57db01 tempest-TestStampPattern-1492869148 None] Lock "cinder-33e21243-1b07-4ee0-b88f-d0cc8199e8d3-delete_volume" released by "delete_volume" :: held 2.910s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:20 devstack sudo[110982]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.963s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:20 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:20 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Deleted volume successfully. Jun 19 04:30:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-edd3f8f8-bf61-41e8-b0b1-9faf29b7353d tempest-VolumeDependencyTests-606433676 None] Lock "cinder-d3efcfe0-44c8-4131-9de2-e8d80f322417-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:20 devstack sudo[110984]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806" returned: 0 in 1.088s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b790717-ad1a-4373-9385-f94cd80d854b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:30:20 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68d715b-a01f-48a4-8d9c-6d94ac314d30]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:20 devstack sudo[110992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b Jun 19 04:30:20 devstack sudo[110992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:21 devstack sudo[110992]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b" returned: 0 in 0.990s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:21 devstack sudo[110998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 Jun 19 04:30:21 devstack sudo[110998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:22 devstack sudo[110998]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806" returned: 0 in 0.845s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:22 devstack sudo[111004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806 Jun 19 04:30:22 devstack sudo[111004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:23 devstack sudo[111004]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b.f571931f-2de3-40ee-8c9d-93d6fe56d806" returned: 0 in 0.735s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Lock "cinder-quobyte-f571931f-2de3-40ee-8c9d-93d6fe56d806" released by "_delete_snapshot" :: held 3.856s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" released by "delete_snapshot" :: held 3.893s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:23 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Created reservations ['26751af3-85f7-42ee-a98f-802fbcbf9325', '6b03e59d-2837-4fa1-9426-de1c29a824e2', '303123be-e874-4156-ac63-3ad3f33700f5', 'eaaa1574-fa1f-4857-89ce-48d65c839dea'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:23 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Delete snapshot completed successfully. Jun 19 04:30:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-793d862e-d29e-455a-8937-c7cf841c078e tempest-SnapshotsActionsTest-257737403 None] Lock "cinder-f571931f-2de3-40ee-8c9d-93d6fe56d806-delete_snapshot" released by "delete_snapshot" :: held 4.076s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Acquiring lock "cinder-4b790717-ad1a-4373-9385-f94cd80d854b-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Lock "cinder-4b790717-ad1a-4373-9385-f94cd80d854b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Acquiring lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:23 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[883bd4b6-543d-4af9-aba6-dd4670c39c7b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:23 devstack sudo[111007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b Jun 19 04:30:23 devstack sudo[111007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:24 devstack sudo[111007]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b" returned: 0 in 0.822s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:24 devstack sudo[111019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b Jun 19 04:30:24 devstack sudo[111019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:25 devstack sudo[111019]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b790717-ad1a-4373-9385-f94cd80d854b" returned: 0 in 0.728s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:25 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Lock "cinder-quobyte-4b790717-ad1a-4373-9385-f94cd80d854b" released by "delete_volume" :: held 1.636s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:25 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=93,cinder:INSERT=28,cinder:UPDATE=96,cinder:DELETE=10 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:30:25 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Created reservations ['fa3c81b4-3987-4d01-8b7a-e93fbd4157f2', '758fe8bb-a377-4c91-93e8-f9d6a26ef9be', 'f5a10cca-cb9d-4b23-b50a-a48c46bbcd87', '786d7db3-ec7a-4d3b-8779-b45a5d78ae63'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:25 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:25 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:25 devstack sudo[111022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:30:25 devstack sudo[111022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:26 devstack sudo[111022]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.709s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:26 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:26 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Deleted volume successfully. Jun 19 04:30:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ea8f9dfd-91ef-4c2b-b658-df8896aab546 tempest-SnapshotsActionsTest-257737403 None] Lock "cinder-4b790717-ad1a-4373-9385-f94cd80d854b-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:35 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=24,cinder:INSERT=8,cinder:UPDATE=38,cinder:DELETE=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:30:36 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:INSERT=2,cinder:UPDATE=8,cinder:SELECT=1,cinder:DELETE=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Flow 'volume_create_manager' (db5d4cc1-44cb-4f01-8d6f-db458aab8cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd50f44-c974-4daf-85fe-43f797b93f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd50f44-c974-4daf-85fe-43f797b93f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1980297098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b513ddd-f014-4d76-8798-75d24062e0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90793fede2e746d0be80f05470906898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:43Z,use_quota=True,user_id='8d31f92a979b41bea30f1abfeb0b4b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87015cc0-3800-4e54-bf36-7e8ecb0633c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87015cc0-3800-4e54-bf36-7e8ecb0633c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38e9aa3-6702-43f0-a558-b2eae13d2590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38e9aa3-6702-43f0-a558-b2eae13d2590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b513ddd-f014-4d76-8798-75d24062e0f4', 'volume_name': 'volume-3b513ddd-f014-4d76-8798-75d24062e0f4', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafd97a3-2a2f-432a-8659-6d3c91ebb6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafd97a3-2a2f-432a-8659-6d3c91ebb6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbe7d5f-b65b-4009-8c15-ac5a3d21ed9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:43 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Volume 3b513ddd-f014-4d76-8798-75d24062e0f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b513ddd-f014-4d76-8798-75d24062e0f4', 'volume_size': 1} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1980297098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b513ddd-f014-4d76-8798-75d24062e0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90793fede2e746d0be80f05470906898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:43Z,use_quota=True,user_id='8d31f92a979b41bea30f1abfeb0b4b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Creating volume 3b513ddd-f014-4d76-8798-75d24062e0f4 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:30:43 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:30:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b513ddd-f014-4d76-8798-75d24062e0f4 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:43 devstack sudo[111031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b513ddd-f014-4d76-8798-75d24062e0f4 1073741824 Jun 19 04:30:43 devstack sudo[111031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:44 devstack sudo[111031]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b513ddd-f014-4d76-8798-75d24062e0f4 1073741824" returned: 0 in 0.900s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b513ddd-f014-4d76-8798-75d24062e0f4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:44 devstack sudo[111037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b513ddd-f014-4d76-8798-75d24062e0f4 Jun 19 04:30:44 devstack sudo[111037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:45 devstack sudo[111037]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b513ddd-f014-4d76-8798-75d24062e0f4" returned: 0 in 0.634s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:30:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbe7d5f-b65b-4009-8c15-ac5a3d21ed9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b513ddd-f014-4d76-8798-75d24062e0f4', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c493a8-02a4-4a07-b92b-c239f71843e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:45 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Volume volume-3b513ddd-f014-4d76-8798-75d24062e0f4 (3b513ddd-f014-4d76-8798-75d24062e0f4): created successfully Jun 19 04:30:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c493a8-02a4-4a07-b92b-c239f71843e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Flow 'volume_create_manager' (db5d4cc1-44cb-4f01-8d6f-db458aab8cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:45 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-785a326a-bb38-404b-b2da-48bcf5cf71ce tempest-VolumesListAdminTestJSON-434648977 None] Created volume successfully. Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Flow 'volume_create_manager' (cc03e049-554c-4fc9-b077-73ff6795ce12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f039360-1773-481c-a57b-c9a031efe3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f039360-1773-481c-a57b-c9a031efe3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-820582742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a92082-02b8-47bd-8ee8-62ae19b363ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90793fede2e746d0be80f05470906898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:46Z,use_quota=True,user_id='8d31f92a979b41bea30f1abfeb0b4b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da36b91-3e11-4fcd-adc3-675249e0a5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da36b91-3e11-4fcd-adc3-675249e0a5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2e1f9a-97e4-4d66-8cf9-c854c53129d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b2e1f9a-97e4-4d66-8cf9-c854c53129d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a92082-02b8-47bd-8ee8-62ae19b363ea', 'volume_name': 'volume-80a92082-02b8-47bd-8ee8-62ae19b363ea', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dadce5f-29f2-4485-8e5f-29f4670ae7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dadce5f-29f2-4485-8e5f-29f4670ae7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d254e5-99c2-4df1-9b19-e85e82eee29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:46 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Volume 80a92082-02b8-47bd-8ee8-62ae19b363ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a92082-02b8-47bd-8ee8-62ae19b363ea', 'volume_size': 1} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-820582742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a92082-02b8-47bd-8ee8-62ae19b363ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90793fede2e746d0be80f05470906898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:46Z,use_quota=True,user_id='8d31f92a979b41bea30f1abfeb0b4b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Creating volume 80a92082-02b8-47bd-8ee8-62ae19b363ea {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:30:46 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:30:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-80a92082-02b8-47bd-8ee8-62ae19b363ea 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:46 devstack sudo[111074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-80a92082-02b8-47bd-8ee8-62ae19b363ea 1073741824 Jun 19 04:30:46 devstack sudo[111074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:47 devstack sudo[111074]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-80a92082-02b8-47bd-8ee8-62ae19b363ea 1073741824" returned: 0 in 0.903s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-80a92082-02b8-47bd-8ee8-62ae19b363ea {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:47 devstack sudo[111082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-80a92082-02b8-47bd-8ee8-62ae19b363ea Jun 19 04:30:47 devstack sudo[111082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:47 devstack sudo[111082]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-80a92082-02b8-47bd-8ee8-62ae19b363ea" returned: 0 in 0.798s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:30:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d254e5-99c2-4df1-9b19-e85e82eee29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a92082-02b8-47bd-8ee8-62ae19b363ea', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5628dc10-530a-45fc-8adb-621ae7d87bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:47 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Volume volume-80a92082-02b8-47bd-8ee8-62ae19b363ea (80a92082-02b8-47bd-8ee8-62ae19b363ea): created successfully Jun 19 04:30:47 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5628dc10-530a-45fc-8adb-621ae7d87bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Flow 'volume_create_manager' (cc03e049-554c-4fc9-b077-73ff6795ce12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:48 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-c3b08fe0-076f-4cf4-be31-a48093fd1c89 tempest-VolumesListAdminTestJSON-434648977 None] Created volume successfully. Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Flow 'volume_create_manager' (ac7d4c6b-3130-4b39-b96f-3d76f8b947ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0172668-98f5-408b-b4cf-ea4c2a75d430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0172668-98f5-408b-b4cf-ea4c2a75d430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-485063268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9399680d-8fd3-4c5c-a27b-1449e9a609ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90793fede2e746d0be80f05470906898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:49Z,use_quota=True,user_id='8d31f92a979b41bea30f1abfeb0b4b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f76deac-cdfd-44bd-91b0-9ecb523fe93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f76deac-cdfd-44bd-91b0-9ecb523fe93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df984c1d-e0c6-4518-a3af-81676c86d551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df984c1d-e0c6-4518-a3af-81676c86d551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9399680d-8fd3-4c5c-a27b-1449e9a609ee', 'volume_name': 'volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342ce4ea-46dc-41af-9fbd-40c6a67e8eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (342ce4ea-46dc-41af-9fbd-40c6a67e8eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca6c47f-262b-4521-a8e5-4719c92e4393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:48 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Volume 9399680d-8fd3-4c5c-a27b-1449e9a609ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee', 'volume_size': 1} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-485063268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9399680d-8fd3-4c5c-a27b-1449e9a609ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90793fede2e746d0be80f05470906898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:49Z,use_quota=True,user_id='8d31f92a979b41bea30f1abfeb0b4b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Creating volume 9399680d-8fd3-4c5c-a27b-1449e9a609ee {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:30:48 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:30:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:48 devstack sudo[111085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee 1073741824 Jun 19 04:30:48 devstack sudo[111085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:49 devstack sudo[111085]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee 1073741824" returned: 0 in 0.929s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:49 devstack sudo[111091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee Jun 19 04:30:49 devstack sudo[111091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:50 devstack sudo[111091]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee" returned: 0 in 0.670s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:30:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca6c47f-262b-4521-a8e5-4719c92e4393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac374c89-b199-40d0-87e9-9c50fdacce95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:50 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Volume volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee (9399680d-8fd3-4c5c-a27b-1449e9a609ee): created successfully Jun 19 04:30:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac374c89-b199-40d0-87e9-9c50fdacce95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:50 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Flow 'volume_create_manager' (ac7d4c6b-3130-4b39-b96f-3d76f8b947ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:50 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e78f22aa-252a-4dee-a25e-1d4cae036253 tempest-VolumesListAdminTestJSON-434648977 None] Created volume successfully. Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Flow 'volume_create_manager' (17ad5642-bd4a-476e-9566-3d490f03896b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ffc8e9-897d-4ad4-8c84-593223bfc124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ffc8e9-897d-4ad4-8c84-593223bfc124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d570b3-bc67-4cd2-8146-5cdcc014acc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6efae401af8d40c39cb4ecc58c0f6ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:51Z,use_quota=True,user_id='090c1afb206e4ccdb459dd9a7a4faea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb073388-d3ed-4dcf-a249-ef3538bfecfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb073388-d3ed-4dcf-a249-ef3538bfecfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18220e64-65cf-4f5d-8f42-e4052ca3e469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18220e64-65cf-4f5d-8f42-e4052ca3e469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d570b3-bc67-4cd2-8146-5cdcc014acc0', 'volume_name': 'volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a6456b-2e9c-4774-b338-a400a854380d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a6456b-2e9c-4774-b338-a400a854380d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f06cee-d233-4451-b37c-9ed410910dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:51 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Volume 04d570b3-bc67-4cd2-8146-5cdcc014acc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0', 'volume_size': 1} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d570b3-bc67-4cd2-8146-5cdcc014acc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6efae401af8d40c39cb4ecc58c0f6ec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:51Z,use_quota=True,user_id='090c1afb206e4ccdb459dd9a7a4faea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Creating volume 04d570b3-bc67-4cd2-8146-5cdcc014acc0 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:30:51 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:30:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:51 devstack sudo[111095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0 1073741824 Jun 19 04:30:51 devstack sudo[111095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:52 devstack sudo[111095]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0 1073741824" returned: 0 in 0.930s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:52 devstack sudo[111101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0 Jun 19 04:30:52 devstack sudo[111101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:53 devstack sudo[111101]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0" returned: 0 in 0.736s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32f06cee-d233-4451-b37c-9ed410910dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f69c62e-e882-452b-ab4b-2b6b5d7555c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:53 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Volume volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0 (04d570b3-bc67-4cd2-8146-5cdcc014acc0): created successfully Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f69c62e-e882-452b-ab4b-2b6b5d7555c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Flow 'volume_create_manager' (17ad5642-bd4a-476e-9566-3d490f03896b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:53 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-9f11940f-0250-49d6-954e-c1ec45c06752 tempest-VolumesListAdminTestJSON-1073481502 None] Created volume successfully. Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Acquiring lock "cinder-04d570b3-bc67-4cd2-8146-5cdcc014acc0-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Lock "cinder-04d570b3-bc67-4cd2-8146-5cdcc014acc0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Acquiring lock "cinder-quobyte-04d570b3-bc67-4cd2-8146-5cdcc014acc0" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Lock "cinder-quobyte-04d570b3-bc67-4cd2-8146-5cdcc014acc0" acquired by "delete_volume" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a843bb-b75f-4b25-8622-bc16c9a07497]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "cinder-9399680d-8fd3-4c5c-a27b-1449e9a609ee-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Lock "cinder-9399680d-8fd3-4c5c-a27b-1449e9a609ee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "cinder-quobyte-9399680d-8fd3-4c5c-a27b-1449e9a609ee" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:53 devstack sudo[111104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0 Jun 19 04:30:53 devstack sudo[111104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Lock "cinder-quobyte-9399680d-8fd3-4c5c-a27b-1449e9a609ee" acquired by "delete_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdd8eef-b44e-414e-9896-cbadc9b1d2a9]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:53 devstack sudo[111106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee Jun 19 04:30:53 devstack sudo[111106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Flow 'volume_create_manager' (c0948874-1847-474d-b4b9-3c60a8a866d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8c3995-32c6-4b0d-91f5-44a0cdc0d435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8c3995-32c6-4b0d-91f5-44a0cdc0d435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1151643581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe20005-9dc6-4f98-82b2-ca67ab000d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4cf40c69c24b05a59f3137d5b62c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:54Z,use_quota=True,user_id='55d17c9fdc3a4827881c914cbd69f2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66da0cd-b45c-4113-9e2b-ab8cbd73657a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66da0cd-b45c-4113-9e2b-ab8cbd73657a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5dae22-662a-4a8d-b822-4f51e1acc3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5dae22-662a-4a8d-b822-4f51e1acc3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe20005-9dc6-4f98-82b2-ca67ab000d3f', 'volume_name': 'volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:54 devstack sudo[111104]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207dc3e9-841c-4764-a2c8-f30fdc36822c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (207dc3e9-841c-4764-a2c8-f30fdc36822c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8b46dd-ba10-4256-af7d-2e41db4647da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:54 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Volume dbe20005-9dc6-4f98-82b2-ca67ab000d3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f', 'volume_size': 1} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1151643581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe20005-9dc6-4f98-82b2-ca67ab000d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4cf40c69c24b05a59f3137d5b62c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:30:54Z,use_quota=True,user_id='55d17c9fdc3a4827881c914cbd69f2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Creating volume dbe20005-9dc6-4f98-82b2-ca67ab000d3f {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:30:54 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0" returned: 0 in 0.871s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:54 devstack sudo[111114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f 1073741824 Jun 19 04:30:54 devstack sudo[111114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:54 devstack sudo[111115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0 Jun 19 04:30:54 devstack sudo[111115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:54 devstack sudo[111106]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee" returned: 0 in 0.806s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:54 devstack sudo[111118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee Jun 19 04:30:54 devstack sudo[111118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:55 devstack sudo[111115]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-04d570b3-bc67-4cd2-8146-5cdcc014acc0" returned: 0 in 0.704s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Lock "cinder-quobyte-04d570b3-bc67-4cd2-8146-5cdcc014acc0" released by "delete_volume" :: held 1.634s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:55 devstack sudo[111118]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9399680d-8fd3-4c5c-a27b-1449e9a609ee" returned: 0 in 0.695s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Created reservations ['e96cc7fb-9161-46ed-9b73-932c2f8878cf', 'e4c87cb1-f04a-431f-aeff-127c5dc3b51a', 'a0e61057-a6f4-4a9d-abd7-d895ad7a3f4f', '0bec44e1-7e7c-48ca-8bd2-314425f2db47'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Lock "cinder-quobyte-9399680d-8fd3-4c5c-a27b-1449e9a609ee" released by "delete_volume" :: held 1.552s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:55 devstack sudo[111114]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f 1073741824" returned: 0 in 0.874s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:55 devstack sudo[111126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:30:55 devstack sudo[111126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Created reservations ['260057f9-1aaa-4015-b6b8-89031c09533a', '39a4fe54-0def-4fb9-8b0e-768bde24cc8b', 'd279e307-da3a-4cf2-befc-d2fad4213393', '549fd94e-21d2-4100-b72b-e379a534bd49'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:55 devstack sudo[111127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f Jun 19 04:30:55 devstack sudo[111127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:55 devstack sudo[111130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:30:55 devstack sudo[111130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "cinder-80a92082-02b8-47bd-8ee8-62ae19b363ea-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Lock "cinder-80a92082-02b8-47bd-8ee8-62ae19b363ea-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "cinder-quobyte-80a92082-02b8-47bd-8ee8-62ae19b363ea" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:56 devstack sudo[111126]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.737s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Lock "cinder-quobyte-80a92082-02b8-47bd-8ee8-62ae19b363ea" acquired by "delete_volume" :: waited 0.026s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:56 devstack sudo[111127]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:56 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Deleted volume successfully. Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f" returned: 0 in 0.759s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[f326fc98-2802-4784-8db9-a85b152ac90d]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-80a92082-02b8-47bd-8ee8-62ae19b363ea {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8b46dd-ba10-4256-af7d-2e41db4647da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d184cf29-aec5-4bc6-b528-4b02d056a1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-16b686a8-daba-4512-a7cd-c6931ba1e080 tempest-VolumesListAdminTestJSON-1073481502 None] Lock "cinder-04d570b3-bc67-4cd2-8146-5cdcc014acc0-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:56 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Volume volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f (dbe20005-9dc6-4f98-82b2-ca67ab000d3f): created successfully Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d184cf29-aec5-4bc6-b528-4b02d056a1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Flow 'volume_create_manager' (c0948874-1847-474d-b4b9-3c60a8a866d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:30:56 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-70db9d73-ab16-4512-abe7-4d037211fe26 tempest-SnapshotDependencyTests-1873910529 None] Created volume successfully. Jun 19 04:30:56 devstack sudo[111130]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.748s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:56 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Deleted volume successfully. Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f7c4e06b-d597-41b6-af19-caf3e0b1e8b5 tempest-VolumesListAdminTestJSON-434648977 None] Lock "cinder-9399680d-8fd3-4c5c-a27b-1449e9a609ee-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:56 devstack sudo[111135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-80a92082-02b8-47bd-8ee8-62ae19b363ea Jun 19 04:30:56 devstack sudo[111135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] Creating offline snapshot 0347b239-4b75-414b-a65b-9438eb0a1df2 of volume dbe20005-9dc6-4f98-82b2-ca67ab000d3f {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ca9dab-2cee-41d0-9bb6-4b2337d1c970]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:56 devstack sudo[111137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f Jun 19 04:30:56 devstack sudo[111137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:57 devstack sudo[111135]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-80a92082-02b8-47bd-8ee8-62ae19b363ea" returned: 0 in 0.788s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-80a92082-02b8-47bd-8ee8-62ae19b363ea {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:57 devstack sudo[111142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-80a92082-02b8-47bd-8ee8-62ae19b363ea Jun 19 04:30:57 devstack sudo[111142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:57 devstack sudo[111137]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f" returned: 0 in 0.767s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:57 devstack sudo[111147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 1G Jun 19 04:30:57 devstack sudo[111147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:57 devstack sudo[111142]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-80a92082-02b8-47bd-8ee8-62ae19b363ea" returned: 0 in 0.646s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:57 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Lock "cinder-quobyte-80a92082-02b8-47bd-8ee8-62ae19b363ea" released by "delete_volume" :: held 1.494s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:57 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Created reservations ['6334671d-114e-4830-953f-6c9d717814a9', '9830c7d3-826e-406e-9c64-a2a8f731e37f', '2e4fc7cc-e14c-4521-ac0e-67cebb5479a1', '119bb16f-0ec3-4f6b-8eb8-0ece02d5f7f9'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:57 devstack sudo[111150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:30:57 devstack sudo[111150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:58 devstack sudo[111147]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 1G" returned: 0 in 0.802s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:58 devstack sudo[111155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 Jun 19 04:30:58 devstack sudo[111155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "cinder-3b513ddd-f014-4d76-8798-75d24062e0f4-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Lock "cinder-3b513ddd-f014-4d76-8798-75d24062e0f4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "cinder-quobyte-3b513ddd-f014-4d76-8798-75d24062e0f4" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Lock "cinder-quobyte-3b513ddd-f014-4d76-8798-75d24062e0f4" acquired by "delete_volume" :: waited 0.014s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:58 devstack sudo[111150]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.668s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:58 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Deleted volume successfully. Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b791a26-2057-4557-8fc5-c95dd0bed6c9]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b513ddd-f014-4d76-8798-75d24062e0f4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-4f4f5e0d-3277-4c5c-9a44-b13d0b9689d5 tempest-VolumesListAdminTestJSON-434648977 None] Lock "cinder-80a92082-02b8-47bd-8ee8-62ae19b363ea-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:58 devstack sudo[111158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b513ddd-f014-4d76-8798-75d24062e0f4 Jun 19 04:30:58 devstack sudo[111158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:58 devstack sudo[111161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:30:58 devstack sudo[111161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2" returned: 0 in 0.784s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:59 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 is being set with open permissions: ugo+rw Jun 19 04:30:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:59 devstack sudo[111155]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:59 devstack sudo[111165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 Jun 19 04:30:59 devstack sudo[111165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:59 devstack sudo[111158]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b513ddd-f014-4d76-8798-75d24062e0f4" returned: 0 in 0.824s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b513ddd-f014-4d76-8798-75d24062e0f4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:59 devstack sudo[111170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b513ddd-f014-4d76-8798-75d24062e0f4 Jun 19 04:30:59 devstack sudo[111170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:59 devstack sudo[111161]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.659s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:30:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:30:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:30:59 devstack sudo[111165]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2" returned: 0 in 0.704s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:59 devstack sudo[111174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.info Jun 19 04:30:59 devstack sudo[111174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:00 devstack sudo[111170]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3b513ddd-f014-4d76-8798-75d24062e0f4" returned: 0 in 0.649s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Lock "cinder-quobyte-3b513ddd-f014-4d76-8798-75d24062e0f4" released by "delete_volume" :: held 1.532s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:00 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Created reservations ['76044d19-21bb-4886-ad49-c7d90297b7d5', '2d89ac72-a2d1-4272-ae1e-dca0519d0910', '1750e5b0-7483-4f56-b459-e1490911be03', '8bfa1be2-e530-44ed-a59e-6347012e87c5'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:31:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:00 devstack sudo[111177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:31:00 devstack sudo[111177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:00 devstack sudo[111174]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.info" returned: 0 in 0.700s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:00 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.info is being set with open permissions: ugo+rw Jun 19 04:31:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:00 devstack sudo[111180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.info Jun 19 04:31:00 devstack sudo[111180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:00 devstack sudo[111177]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.685s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:00 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:31:00 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Deleted volume successfully. Jun 19 04:31:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8d7d5faf-8540-4cbe-a623-fe6bdf5f4f9e tempest-VolumesListAdminTestJSON-434648977 None] Lock "cinder-3b513ddd-f014-4d76-8798-75d24062e0f4-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:01 devstack sudo[111180]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.info" returned: 0 in 0.726s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.576s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:01 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-355c1835-1843-49cd-bdb4-8110529370f4 tempest-SnapshotDependencyTests-1873910529 None] Create snapshot completed successfully Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Flow 'volume_create_manager' (a64ce03a-608a-45d8-9b57-6cc5baf8d0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e214cab2-54f2-4a18-b751-6d167be14454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e214cab2-54f2-4a18-b751-6d167be14454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993c6ebf-fea3-4ae3-869b-8b5e2437d057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b4cf40c69c24b05a59f3137d5b62c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0347b239-4b75-414b-a65b-9438eb0a1df2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:03Z,use_quota=True,user_id='55d17c9fdc3a4827881c914cbd69f2a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a41690a-1e60-44a7-b46c-842530dfbdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a41690a-1e60-44a7-b46c-842530dfbdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312e4851-0e25-4de5-9c45-0b2fc50af7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312e4851-0e25-4de5-9c45-0b2fc50af7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '993c6ebf-fea3-4ae3-869b-8b5e2437d057', 'volume_name': 'volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057', 'volume_size': 1, 'snapshot_id': '0347b239-4b75-414b-a65b-9438eb0a1df2'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e863a0-1309-4f0d-876a-adbc82c510f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9e863a0-1309-4f0d-876a-adbc82c510f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ee42dc-740b-4aa7-9884-a87bd1c3fd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:02 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Volume 993c6ebf-fea3-4ae3-869b-8b5e2437d057: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057', 'volume_size': 1, 'snapshot_id': '0347b239-4b75-414b-a65b-9438eb0a1df2'} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "cinder-quobyte-0347b239-4b75-414b-a65b-9438eb0a1df2-993c6ebf-fea3-4ae3-869b-8b5e2437d057" by "_create_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-quobyte-0347b239-4b75-414b-a65b-9438eb0a1df2-993c6ebf-fea3-4ae3-869b-8b5e2437d057" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Creating volume 993c6ebf-fea3-4ae3-869b-8b5e2437d057 from snapshot 0347b239-4b75-414b-a65b-9438eb0a1df2 {{(pid=93530) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "cinder-quobyte-993c6ebf-fea3-4ae3-869b-8b5e2437d057" by "_copy_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-quobyte-993c6ebf-fea3-4ae3-869b-8b5e2437d057" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] snapshot: 0347b239-4b75-414b-a65b-9438eb0a1df2, volume: 993c6ebf-fea3-4ae3-869b-8b5e2437d057, {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b1d79a-8dc8-46a8-b2bf-0e024703c506]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:03 devstack sudo[111187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 Jun 19 04:31:03 devstack sudo[111187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:03 devstack sudo[111187]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2" returned: 0 in 0.819s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:31:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:31:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Creating direct copy from snapshot {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:31:03 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e71361-ea4a-4f28-b829-93348d12cc9e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:03 devstack sudo[111192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f Jun 19 04:31:03 devstack sudo[111192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:04 devstack sudo[111192]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f" returned: 0 in 0.767s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:04 devstack cinder-volume[93530]: DEBUG cinder.utils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Path /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057 not found in is_blk_device check {{(pid=93530) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:31:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:04 devstack sudo[111197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057 Jun 19 04:31:04 devstack sudo[111197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:09 devstack sudo[111197]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057" returned: 0 in 5.101s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:09 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bed7bf-aa4e-4d96-afd2-7f186898842b]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:09 devstack sudo[111211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f Jun 19 04:31:09 devstack sudo[111211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:10 devstack sudo[111211]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f" returned: 0 in 1.002s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:10 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Image conversion details: src /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:31:10 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Converted 1024.00 MB image at 200.69 MB/s Jun 19 04:31:10 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057 is being set with open permissions: ugo+rw Jun 19 04:31:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:10 devstack sudo[111218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057 Jun 19 04:31:10 devstack sudo[111218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:11 devstack sudo[111218]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057" returned: 0 in 0.775s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-quobyte-993c6ebf-fea3-4ae3-869b-8b5e2437d057" released by "_copy_volume_from_snapshot" :: held 8.565s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-quobyte-0347b239-4b75-414b-a65b-9438eb0a1df2-993c6ebf-fea3-4ae3-869b-8b5e2437d057" released by "_create_volume_from_snapshot" :: held 8.598s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.616s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ee42dc-740b-4aa7-9884-a87bd1c3fd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057', 'volume_size': 1, 'snapshot_id': '0347b239-4b75-414b-a65b-9438eb0a1df2'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ff7754-d02a-4d46-9d99-167e061a02da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:11 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Volume volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057 (993c6ebf-fea3-4ae3-869b-8b5e2437d057): created successfully Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ff7754-d02a-4d46-9d99-167e061a02da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Flow 'volume_create_manager' (a64ce03a-608a-45d8-9b57-6cc5baf8d0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:11 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-47481f05-8198-47fb-8e78-611a61e0d89e tempest-SnapshotDependencyTests-1873910529 None] Created volume successfully. Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "cinder-0347b239-4b75-414b-a65b-9438eb0a1df2-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-0347b239-4b75-414b-a65b-9438eb0a1df2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "cinder-quobyte-dbe20005-9dc6-4f98-82b2-ca67ab000d3f" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-quobyte-dbe20005-9dc6-4f98-82b2-ca67ab000d3f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "cinder-quobyte-0347b239-4b75-414b-a65b-9438eb0a1df2" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-quobyte-0347b239-4b75-414b-a65b-9438eb0a1df2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Deleting offline snapshot 0347b239-4b75-414b-a65b-9438eb0a1df2 of volume dbe20005-9dc6-4f98-82b2-ca67ab000d3f {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] snapshot_file for this snap is: volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84356ae-d822-427d-a6bb-2fb912410ca6]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:11 devstack sudo[111222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 Jun 19 04:31:11 devstack sudo[111222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:12 devstack sudo[111222]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2" returned: 0 in 0.865s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:12 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:31:12 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c484824e-33c1-42fc-aa9a-8c4b94bb55f0]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:12 devstack sudo[111227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f Jun 19 04:31:12 devstack sudo[111227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:13 devstack sudo[111227]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f" returned: 0 in 0.865s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:13 devstack sudo[111232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 Jun 19 04:31:13 devstack sudo[111232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:14 devstack sudo[111232]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2" returned: 0 in 0.853s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:14 devstack sudo[111237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2 Jun 19 04:31:14 devstack sudo[111237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:15 devstack sudo[111237]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f.0347b239-4b75-414b-a65b-9438eb0a1df2" returned: 0 in 0.767s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-quobyte-0347b239-4b75-414b-a65b-9438eb0a1df2" released by "_delete_snapshot" :: held 3.508s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-quobyte-dbe20005-9dc6-4f98-82b2-ca67ab000d3f" released by "delete_snapshot" :: held 3.536s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Created reservations ['d5974060-870a-46d8-92b5-04f4cf8b1da7', 'b5eab830-9107-4e31-8ba1-49feb257176a', '8917b9b2-c158-4561-b996-639f8b21459c', '53ea0fae-34d6-4be7-af0e-a51298519466'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:31:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Delete snapshot completed successfully. Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c1ed34ab-8d24-4b3b-b818-d83276eb0f2b tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-0347b239-4b75-414b-a65b-9438eb0a1df2-delete_snapshot" released by "delete_snapshot" :: held 3.726s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Flow 'volume_create_manager' (f8ba78f5-dc81-4cb6-bf6d-5d4bf27b90f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe84a5f-b4f2-4a79-93a8-daec77ec7734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe84a5f-b4f2-4a79-93a8-daec77ec7734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1871576416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c66e774-5cc6-4586-a471-0e0c672cf583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48b32464c85480e87d25c5baef25454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:16Z,use_quota=True,user_id='960185bfbd4f43cc88a20942333b1f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321843c9-a0d7-4c28-a5dc-2ba11d91f3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321843c9-a0d7-4c28-a5dc-2ba11d91f3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba23259-1fa2-4506-b19e-e3993ccaf5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba23259-1fa2-4506-b19e-e3993ccaf5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c66e774-5cc6-4586-a471-0e0c672cf583', 'volume_name': 'volume-9c66e774-5cc6-4586-a471-0e0c672cf583', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f745776-f76e-483d-a1c1-7ea57a7af834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f745776-f76e-483d-a1c1-7ea57a7af834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924c4729-8ef0-49c5-b083-a27ff97a96d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:15 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Volume 9c66e774-5cc6-4586-a471-0e0c672cf583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c66e774-5cc6-4586-a471-0e0c672cf583', 'volume_size': 1} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1871576416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c66e774-5cc6-4586-a471-0e0c672cf583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c48b32464c85480e87d25c5baef25454',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:16Z,use_quota=True,user_id='960185bfbd4f43cc88a20942333b1f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Creating volume 9c66e774-5cc6-4586-a471-0e0c672cf583 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:31:15 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:31:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:15 devstack sudo[111240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 1073741824 Jun 19 04:31:15 devstack sudo[111240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "cinder-dbe20005-9dc6-4f98-82b2-ca67ab000d3f-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-dbe20005-9dc6-4f98-82b2-ca67ab000d3f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "cinder-quobyte-dbe20005-9dc6-4f98-82b2-ca67ab000d3f" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-quobyte-dbe20005-9dc6-4f98-82b2-ca67ab000d3f" acquired by "delete_volume" :: waited 0.015s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:16 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[295e5ab0-37f0-4cd9-9f00-4fd1005442f6]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:16 devstack sudo[111242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f Jun 19 04:31:16 devstack sudo[111242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:16 devstack sudo[111240]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 1073741824" returned: 0 in 0.865s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:16 devstack sudo[111247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 Jun 19 04:31:16 devstack sudo[111247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:16 devstack sudo[111242]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f" returned: 0 in 0.763s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:16 devstack sudo[111252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f Jun 19 04:31:16 devstack sudo[111252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:17 devstack sudo[111247]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583" returned: 0 in 0.641s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (924c4729-8ef0-49c5-b083-a27ff97a96d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c66e774-5cc6-4586-a471-0e0c672cf583', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4a29b9-cacc-4dc7-98da-6e4566189bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:17 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Volume volume-9c66e774-5cc6-4586-a471-0e0c672cf583 (9c66e774-5cc6-4586-a471-0e0c672cf583): created successfully Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4a29b9-cacc-4dc7-98da-6e4566189bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Flow 'volume_create_manager' (f8ba78f5-dc81-4cb6-bf6d-5d4bf27b90f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:17 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-aa5f72d4-35ef-4e0f-9a97-2a0d82db1146 tempest-VolumesActionsTest-280344986 None] Created volume successfully. Jun 19 04:31:17 devstack sudo[111252]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-dbe20005-9dc6-4f98-82b2-ca67ab000d3f" returned: 0 in 0.649s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-quobyte-dbe20005-9dc6-4f98-82b2-ca67ab000d3f" released by "delete_volume" :: held 1.474s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Created reservations ['a2f0ffa6-37b1-4456-9904-a8a2110efd8c', 'e25ae8e2-8f53-4f55-9304-06a6a7fd5ab9', '6c5106f7-1593-406f-b14b-80ead1a3b101', '003c4e63-bb17-4ee5-8a2d-6eea70cdfeef'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:17 devstack sudo[111256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:31:17 devstack sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "cinder-993c6ebf-fea3-4ae3-869b-8b5e2437d057-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-993c6ebf-fea3-4ae3-869b-8b5e2437d057-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "cinder-quobyte-993c6ebf-fea3-4ae3-869b-8b5e2437d057" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-quobyte-993c6ebf-fea3-4ae3-869b-8b5e2437d057" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:18 devstack sudo[111256]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.693s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:18 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:31:18 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Deleted volume successfully. Jun 19 04:31:18 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ca7cba-b62f-4c4e-ad0d-d0f94da51f78]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a46194da-2703-45f0-bf5d-3c36ea50d80e tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-dbe20005-9dc6-4f98-82b2-ca67ab000d3f-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:18 devstack sudo[111260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057 Jun 19 04:31:18 devstack sudo[111260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:19 devstack sudo[111260]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057" returned: 0 in 0.790s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:19 devstack sudo[111268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057 Jun 19 04:31:19 devstack sudo[111268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:19 devstack sudo[111268]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-993c6ebf-fea3-4ae3-869b-8b5e2437d057" returned: 0 in 0.717s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-quobyte-993c6ebf-fea3-4ae3-869b-8b5e2437d057" released by "delete_volume" :: held 1.555s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:19 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Created reservations ['8ae07ddf-6abb-40b6-aac8-5eb5afaf6d15', 'e6e418d7-cc0d-4f54-a42a-b9771fea3a10', '3a5419dd-fd56-4b7a-8901-86ca17bcbf87', 'fc576a80-74a6-4a90-baab-cb9b57c7829b'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:31:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:20 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:20 devstack sudo[111271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:31:20 devstack sudo[111271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:20 devstack sudo[111271]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.657s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:20 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:31:20 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Deleted volume successfully. Jun 19 04:31:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7a82ba93-d89b-4efe-8d8b-8c1214e9e344 tempest-SnapshotDependencyTests-1873910529 None] Lock "cinder-993c6ebf-fea3-4ae3-869b-8b5e2437d057-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:30 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=56,cinder:UPDATE=74,cinder:DELETE=7,cinder:INSERT=17 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:31:30 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=76,cinder:INSERT=18,cinder:SELECT=51,cinder:DELETE=7 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:31:34 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-015c7205-e9fe-4a45-a9dd-d678e59a3a9a tempest-VolumesActionsTest-280344986 None] Acquiring lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583" by "attach_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:34 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-015c7205-e9fe-4a45-a9dd-d678e59a3a9a tempest-VolumesActionsTest-280344986 None] Lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583" acquired by "attach_volume" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:34 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-015c7205-e9fe-4a45-a9dd-d678e59a3a9a tempest-VolumesActionsTest-280344986 None] Attaching volume 9c66e774-5cc6-4586-a471-0e0c672cf583 to instance 86d6ad21-a1b8-4656-8f38-535bb5fae1a2 at mountpoint /dev/vdb on host None. Jun 19 04:31:34 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-015c7205-e9fe-4a45-a9dd-d678e59a3a9a tempest-VolumesActionsTest-280344986 None] Attach volume completed successfully. Jun 19 04:31:34 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-015c7205-e9fe-4a45-a9dd-d678e59a3a9a tempest-VolumesActionsTest-280344986 None] Lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583" released by "attach_volume" :: held 0.092s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d78feb92-e851-415f-938a-abfe25f243b3 tempest-VolumesActionsTest-280344986 None] Acquiring lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583-detach_volume" by "detach_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d78feb92-e851-415f-938a-abfe25f243b3 tempest-VolumesActionsTest-280344986 None] Lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:35 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d78feb92-e851-415f-938a-abfe25f243b3 tempest-VolumesActionsTest-280344986 None] Detaching volume 9c66e774-5cc6-4586-a471-0e0c672cf583 from instance 86d6ad21-a1b8-4656-8f38-535bb5fae1a2. Jun 19 04:31:35 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d78feb92-e851-415f-938a-abfe25f243b3 tempest-VolumesActionsTest-280344986 None] Detach volume completed successfully. Jun 19 04:31:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d78feb92-e851-415f-938a-abfe25f243b3 tempest-VolumesActionsTest-280344986 None] Lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:45 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=2 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:31:45 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:31:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-483e0993-a8d2-41a2-94be-51f87fa863a6 tempest-VolumesActionsTest-280344986 None] Acquiring lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583" by "attach_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-483e0993-a8d2-41a2-94be-51f87fa863a6 tempest-VolumesActionsTest-280344986 None] Lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583" acquired by "attach_volume" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:58 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-483e0993-a8d2-41a2-94be-51f87fa863a6 tempest-VolumesActionsTest-280344986 None] Attaching volume 9c66e774-5cc6-4586-a471-0e0c672cf583 to instance c30f05e8-b4a3-4b59-80e2-c67d15598b2d at mountpoint /dev/vdb on host None. Jun 19 04:31:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:31:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:58 devstack sudo[111575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:31:58 devstack sudo[111575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:58 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-483e0993-a8d2-41a2-94be-51f87fa863a6 tempest-VolumesActionsTest-280344986 None] Attach volume completed successfully. Jun 19 04:31:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-483e0993-a8d2-41a2-94be-51f87fa863a6 tempest-VolumesActionsTest-280344986 None] Lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583" released by "attach_volume" :: held 0.120s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:59 devstack sudo[111575]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.664s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:31:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:31:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:31:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:31:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d17da597-6441-4ea1-b3c2-b4ee6cef2257 tempest-VolumesActionsTest-280344986 None] Acquiring lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583-detach_volume" by "detach_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d17da597-6441-4ea1-b3c2-b4ee6cef2257 tempest-VolumesActionsTest-280344986 None] Lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:59 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d17da597-6441-4ea1-b3c2-b4ee6cef2257 tempest-VolumesActionsTest-280344986 None] Detaching volume 9c66e774-5cc6-4586-a471-0e0c672cf583 from instance c30f05e8-b4a3-4b59-80e2-c67d15598b2d. Jun 19 04:31:59 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d17da597-6441-4ea1-b3c2-b4ee6cef2257 tempest-VolumesActionsTest-280344986 None] Detach volume completed successfully. Jun 19 04:31:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d17da597-6441-4ea1-b3c2-b4ee6cef2257 tempest-VolumesActionsTest-280344986 None] Lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583-detach_volume" released by "detach_volume" :: held 0.060s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:09 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84e049e-4333-4891-8b96-e30b53d4bb83]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:09 devstack sudo[111627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 Jun 19 04:32:09 devstack sudo[111627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:09 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:32:10 devstack sudo[111627]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583" returned: 0 in 0.780s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:10 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6550bc5-9148-4258-85ac-482e16a5ab7e]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:10 devstack sudo[111634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 Jun 19 04:32:10 devstack sudo[111634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:10 devstack sudo[111634]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583" returned: 0 in 0.772s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.48d1dbb5-7d85-48b1-8c37-65425b3715a7mfl5x9vj.img {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:11 devstack sudo[111639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.48d1dbb5-7d85-48b1-8c37-65425b3715a7mfl5x9vj.img Jun 19 04:32:11 devstack sudo[111639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:15 devstack sudo[111639]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.48d1dbb5-7d85-48b1-8c37-65425b3715a7mfl5x9vj.img" returned: 0 in 4.153s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:15 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c47af5-6a5a-4888-b954-fa958780fcb9]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:15 devstack sudo[111653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 Jun 19 04:32:15 devstack sudo[111653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:16 devstack sudo[111653]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583" returned: 0 in 0.943s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:16 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] Image conversion details: src /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583, size 1024.00 MB, duration 4.15 sec, destination /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.48d1dbb5-7d85-48b1-8c37-65425b3715a7mfl5x9vj.img {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:32:16 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] Converted 1024.00 MB image at 246.49 MB/s Jun 19 04:32:16 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] 48d1dbb5-7d85-48b1-8c37-65425b3715a7 was raw, no need to convert to raw {{(pid=93530) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 19 04:32:26 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:32:26 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:32:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.108s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] Uploaded volume to glance image-id: 48d1dbb5-7d85-48b1-8c37-65425b3715a7. {{(pid=93530) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 19 04:32:34 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-83e04793-b73f-4011-a990-37a7d834832d tempest-VolumesActionsTest-280344986 None] Copy volume to image completed successfully. Jun 19 04:32:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:36 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e3de63-f50a-4a02-9b77-efac1db1f3f1]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:36 devstack sudo[111668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 Jun 19 04:32:36 devstack sudo[111668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:36 devstack sudo[111668]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583" returned: 0 in 0.710s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:36 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3e5e41-d6b6-4bf6-b8c4-360c7ca5f176]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:36 devstack sudo[111673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 Jun 19 04:32:36 devstack sudo[111673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:37 devstack sudo[111673]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583" returned: 0 in 0.732s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:37 devstack sudo[111678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img Jun 19 04:32:37 devstack sudo[111678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:41 devstack sudo[111678]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img" returned: 0 in 4.039s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:41 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa76cc7-6864-44dd-8370-386862d2d837]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:41 devstack sudo[111691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 Jun 19 04:32:41 devstack sudo[111691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:42 devstack sudo[111691]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583" returned: 0 in 0.955s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:42 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Image conversion details: src /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583, size 1024.00 MB, duration 4.04 sec, destination /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:32:42 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Converted 1024.00 MB image at 253.48 MB/s Jun 19 04:32:42 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] 97a0bf96-c802-46c4-b53c-4f34598cd0fc was raw, converting to qcow2 {{(pid=93530) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 19 04:32:42 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[723e790b-330c-4574-8a1b-6ce127d3947a]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:42 devstack sudo[111696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img Jun 19 04:32:42 devstack sudo[111696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:43 devstack sudo[111696]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img" returned: 0 in 0.682s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:43 devstack sudo[111700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img Jun 19 04:32:43 devstack sudo[111700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:43 devstack sudo[111700]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img" returned: 1 in 0.687s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:32:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img /opt/stack/data/cinder/conversion/vol_upload_lquo60up {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:43 devstack sudo[111705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img /opt/stack/data/cinder/conversion/vol_upload_lquo60up Jun 19 04:32:43 devstack sudo[111705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:44 devstack sudo[111705]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img /opt/stack/data/cinder/conversion/vol_upload_lquo60up" returned: 0 in 0.644s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:44 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Image conversion details: src /opt/stack/data/cinder/conversion/9c66e774-5cc6-4586-a471-0e0c672cf583.temp_image.97a0bf96-c802-46c4-b53c-4f34598cd0fcufm9mnlx.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_lquo60up {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:32:44 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 19 04:32:44 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1688a6-205c-4bbe-b092-9cc6daa133a6]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lquo60up {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:44 devstack sudo[111710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lquo60up Jun 19 04:32:44 devstack sudo[111710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:45 devstack sudo[111710]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lquo60up" returned: 0 in 0.674s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:46 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:32:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.409s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Uploaded volume to glance image-id: 97a0bf96-c802-46c4-b53c-4f34598cd0fc. {{(pid=93530) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 19 04:32:46 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-c9711e39-729a-4e6b-8ca6-3a0ee564b243 tempest-VolumesActionsTest-280344986 None] Copy volume to image completed successfully. Jun 19 04:32:47 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Acquiring lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:47 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:47 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Acquiring lock "cinder-quobyte-9c66e774-5cc6-4586-a471-0e0c672cf583" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:47 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Lock "cinder-quobyte-9c66e774-5cc6-4586-a471-0e0c672cf583" acquired by "delete_volume" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:47 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff68d7de-4bb6-41c2-9528-4ed3dab858e6]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:47 devstack sudo[111751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 Jun 19 04:32:47 devstack sudo[111751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:47 devstack sudo[111751]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583" returned: 0 in 0.719s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:47 devstack sudo[111756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583 Jun 19 04:32:47 devstack sudo[111756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:48 devstack sudo[111756]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-9c66e774-5cc6-4586-a471-0e0c672cf583" returned: 0 in 0.643s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:48 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Lock "cinder-quobyte-9c66e774-5cc6-4586-a471-0e0c672cf583" released by "delete_volume" :: held 1.397s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:48 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Created reservations ['3bb337d3-2dd8-4cef-aa76-54a706d4b6c2', '26e1f9b9-30aa-4b20-bc0e-b98868f600be', 'b0292d7c-a01f-43ab-a451-9501db0e544d', 'd2a48078-8703-461d-b055-083100069d74'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:48 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:48 devstack sudo[111759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:32:48 devstack sudo[111759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:49 devstack sudo[111759]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.616s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:49 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:49 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Deleted volume successfully. Jun 19 04:32:49 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-57b71cd3-a769-439c-89e2-9f67989a0b70 tempest-VolumesActionsTest-280344986 None] Lock "cinder-9c66e774-5cc6-4586-a471-0e0c672cf583-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:58 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:32:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:32:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:58 devstack sudo[111766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:32:58 devstack sudo[111766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:59 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:32:59 devstack sudo[111766]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.671s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:32:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:32:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Flow 'volume_create_manager' (47279ba0-bec6-43ab-b887-a3ac30240fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169e3702-8ce9-41e5-9f88-b3e3066dbcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (169e3702-8ce9-41e5-9f88-b3e3066dbcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1104743727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b88ed23-b817-4147-a475-0ca5d0f096b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71e038358a469bbfd8197857d10abf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:17Z,use_quota=True,user_id='8633b1c5c81e44ebbc6036882d34724a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4e6d6e-32fc-4470-a12d-dc1f527921e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4e6d6e-32fc-4470-a12d-dc1f527921e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28cf6d4b-626a-4fde-a4d4-89d0717269ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28cf6d4b-626a-4fde-a4d4-89d0717269ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b88ed23-b817-4147-a475-0ca5d0f096b5', 'volume_name': 'volume-4b88ed23-b817-4147-a475-0ca5d0f096b5', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f941ea-cf51-449c-9554-cfe6461ff232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02f941ea-cf51-449c-9554-cfe6461ff232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b08b660-a890-4fe7-ac71-7cf2d57922d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:16 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Volume 4b88ed23-b817-4147-a475-0ca5d0f096b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b88ed23-b817-4147-a475-0ca5d0f096b5', 'volume_size': 1} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1104743727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b88ed23-b817-4147-a475-0ca5d0f096b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71e038358a469bbfd8197857d10abf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:17Z,use_quota=True,user_id='8633b1c5c81e44ebbc6036882d34724a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Creating volume 4b88ed23-b817-4147-a475-0ca5d0f096b5 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:16 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:16 devstack sudo[111775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5 1073741824 Jun 19 04:33:16 devstack sudo[111775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Flow 'volume_create_manager' (40a6e28c-19f3-4d46-968a-9c52c254556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd2e88c-39d8-4c90-a02d-c5065c69b3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd2e88c-39d8-4c90-a02d-c5065c69b3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1377709322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0be12ff-1618-4061-891d-9fb6cf2d2185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71e038358a469bbfd8197857d10abf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:17Z,use_quota=True,user_id='8633b1c5c81e44ebbc6036882d34724a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:16 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f8474b-7db8-4223-b356-178ed505703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53f8474b-7db8-4223-b356-178ed505703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dbf59e-2d17-4a26-afbe-842d8ec02bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31dbf59e-2d17-4a26-afbe-842d8ec02bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0be12ff-1618-4061-891d-9fb6cf2d2185', 'volume_name': 'volume-a0be12ff-1618-4061-891d-9fb6cf2d2185', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bf6a91-a38e-4aef-8306-6e24a01aca1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bf6a91-a38e-4aef-8306-6e24a01aca1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:17 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d3408e-5516-4ffc-94b8-f1a1c7cb6bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:17 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Volume a0be12ff-1618-4061-891d-9fb6cf2d2185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0be12ff-1618-4061-891d-9fb6cf2d2185', 'volume_size': 1} Jun 19 04:33:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:17 devstack sudo[111775]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5 1073741824" returned: 0 in 0.914s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:17 devstack sudo[111781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5 Jun 19 04:33:17 devstack sudo[111781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:18 devstack sudo[111781]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5" returned: 0 in 0.675s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.301s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1377709322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0be12ff-1618-4061-891d-9fb6cf2d2185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71e038358a469bbfd8197857d10abf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:17Z,use_quota=True,user_id='8633b1c5c81e44ebbc6036882d34724a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Creating volume a0be12ff-1618-4061-891d-9fb6cf2d2185 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:18 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b08b660-a890-4fe7-ac71-7cf2d57922d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b88ed23-b817-4147-a475-0ca5d0f096b5', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:18 devstack sudo[111784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185 1073741824 Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b1adcc-af1c-4b31-bee8-2ae3cc1ec90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:18 devstack sudo[111784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:18 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Volume volume-4b88ed23-b817-4147-a475-0ca5d0f096b5 (4b88ed23-b817-4147-a475-0ca5d0f096b5): created successfully Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b1adcc-af1c-4b31-bee8-2ae3cc1ec90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Flow 'volume_create_manager' (47279ba0-bec6-43ab-b887-a3ac30240fba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:18 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-50806470-fb94-4844-b9a9-9ccbf6abf9b1 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Created volume successfully. Jun 19 04:33:19 devstack sudo[111784]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185 1073741824" returned: 0 in 0.905s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:19 devstack sudo[111790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185 Jun 19 04:33:19 devstack sudo[111790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:19 devstack sudo[111790]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185" returned: 0 in 0.679s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d3408e-5516-4ffc-94b8-f1a1c7cb6bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0be12ff-1618-4061-891d-9fb6cf2d2185', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69fb78bf-dd29-42b0-ace7-0f1ffbd8df36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:19 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Volume volume-a0be12ff-1618-4061-891d-9fb6cf2d2185 (a0be12ff-1618-4061-891d-9fb6cf2d2185): created successfully Jun 19 04:33:19 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69fb78bf-dd29-42b0-ace7-0f1ffbd8df36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:20 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Flow 'volume_create_manager' (40a6e28c-19f3-4d46-968a-9c52c254556d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:20 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-b8616646-7cd1-4226-8689-f4fb7bb229cf tempest-TestServerVolumeAttachmentScenario-1352453279 None] Created volume successfully. Jun 19 04:33:30 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=4,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:33:30 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=5,cinder:SELECT=4,cinder:DELETE=2 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:33:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-8367b304-3175-421a-8898-86079f2fac58 req-c5e417c3-7cab-4245-affa-284043ac2fb5 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-8367b304-3175-421a-8898-86079f2fac58 req-c5e417c3-7cab-4245-affa-284043ac2fb5 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:58 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c64eeb-6dad-471d-ae2d-b5f8c6b24c13]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-8367b304-3175-421a-8898-86079f2fac58 req-c5e417c3-7cab-4245-affa-284043ac2fb5 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:33:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:58 devstack sudo[111981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:33:58 devstack sudo[111981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:58 devstack sudo[111980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5 Jun 19 04:33:58 devstack sudo[111980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:59 devstack sudo[111981]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.645s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:33:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:33:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:33:59 devstack sudo[111980]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-8367b304-3175-421a-8898-86079f2fac58 req-c5e417c3-7cab-4245-affa-284043ac2fb5 tempest-TestServerVolumeAttachmentScenario-1352453279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5" returned: 0 in 0.771s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-8367b304-3175-421a-8898-86079f2fac58 req-c5e417c3-7cab-4245-affa-284043ac2fb5 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.787s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-8367b304-3175-421a-8898-86079f2fac58 req-c5e417c3-7cab-4245-affa-284043ac2fb5 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-4b88ed23-b817-4147-a475-0ca5d0f096b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0aa2fad0-e79b-4e1d-8c4e-315b5f380498', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:33:59 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-8367b304-3175-421a-8898-86079f2fac58 req-c5e417c3-7cab-4245-affa-284043ac2fb5 tempest-TestServerVolumeAttachmentScenario-1352453279 None] attachment_update completed successfully. Jun 19 04:34:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-70d015a1-ee42-4024-938d-304366fd5a83 req-35cd9e12-7986-4627-982e-355d7b0fe3ae tempest-TestServerVolumeAttachmentScenario-1352453279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-70d015a1-ee42-4024-938d-304366fd5a83 req-35cd9e12-7986-4627-982e-355d7b0fe3ae tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:08 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[461dfb56-107c-4905-98ff-41cafcdf76cb]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-70d015a1-ee42-4024-938d-304366fd5a83 req-35cd9e12-7986-4627-982e-355d7b0fe3ae tempest-TestServerVolumeAttachmentScenario-1352453279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:08 devstack sudo[112394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185 Jun 19 04:34:08 devstack sudo[112394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:09 devstack sudo[112394]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [req-70d015a1-ee42-4024-938d-304366fd5a83 req-35cd9e12-7986-4627-982e-355d7b0fe3ae tempest-TestServerVolumeAttachmentScenario-1352453279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185" returned: 0 in 0.738s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [req-70d015a1-ee42-4024-938d-304366fd5a83 req-35cd9e12-7986-4627-982e-355d7b0fe3ae tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.754s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-70d015a1-ee42-4024-938d-304366fd5a83 req-35cd9e12-7986-4627-982e-355d7b0fe3ae tempest-TestServerVolumeAttachmentScenario-1352453279 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0', 'name': 'volume-a0be12ff-1618-4061-891d-9fb6cf2d2185', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f559003-ed85-4cd8-becf-79798a1f9f61', 'enforce_multipath': True} {{(pid=93530) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:34:09 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-70d015a1-ee42-4024-938d-304366fd5a83 req-35cd9e12-7986-4627-982e-355d7b0fe3ae tempest-TestServerVolumeAttachmentScenario-1352453279 None] attachment_update completed successfully. Jun 19 04:34:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-2cd4aee7-218a-40c6-960a-e2bc712a565a req-eb2806e2-f159-47f2-b38a-85bf64dae9b6 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Terminate volume connection completed successfully. Jun 19 04:34:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-2cd4aee7-218a-40c6-960a-e2bc712a565a req-eb2806e2-f159-47f2-b38a-85bf64dae9b6 tempest-TestServerVolumeAttachmentScenario-1352453279 None] Deleting attachment 1f559003-ed85-4cd8-becf-79798a1f9f61. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:34:18 devstack cinder-volume[93530]: INFO cinder.volume.manager [req-dafebe76-4e8c-46cc-9a74-af78d35570af req-70644cfa-6893-4743-8409-b8275649303f tempest-TestServerVolumeAttachmentScenario-1352453279 None] Terminate volume connection completed successfully. Jun 19 04:34:18 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [req-dafebe76-4e8c-46cc-9a74-af78d35570af req-70644cfa-6893-4743-8409-b8275649303f tempest-TestServerVolumeAttachmentScenario-1352453279 None] Deleting attachment 0aa2fad0-e79b-4e1d-8c4e-315b5f380498. {{(pid=93530) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:34:25 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:34:28 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=15,cinder:UPDATE=2 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:34:28 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Acquiring lock "cinder-a0be12ff-1618-4061-891d-9fb6cf2d2185-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:29 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "cinder-a0be12ff-1618-4061-891d-9fb6cf2d2185-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:29 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Acquiring lock "cinder-quobyte-a0be12ff-1618-4061-891d-9fb6cf2d2185" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:29 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "cinder-quobyte-a0be12ff-1618-4061-891d-9fb6cf2d2185" acquired by "delete_volume" :: waited 0.014s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:29 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[693a7e9c-b688-43a1-ab3d-5dd863f1e382]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:29 devstack sudo[112496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185 Jun 19 04:34:29 devstack sudo[112496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:29 devstack sudo[112496]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185" returned: 0 in 0.708s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:29 devstack sudo[112502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185 Jun 19 04:34:29 devstack sudo[112502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:30 devstack sudo[112502]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-a0be12ff-1618-4061-891d-9fb6cf2d2185" returned: 0 in 0.614s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:30 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "cinder-quobyte-a0be12ff-1618-4061-891d-9fb6cf2d2185" released by "delete_volume" :: held 1.359s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:30 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Created reservations ['3f3c6867-1132-49a5-be0b-1b52a99cab8f', 'a3014f66-3459-4ca7-b1b7-7d08824470cd', '253da436-6633-4866-b0cf-091246eef8dc', 'a4c5814a-28ac-4693-a8ec-570c2790e5e2'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:30 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:30 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:30 devstack sudo[112505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:34:30 devstack sudo[112505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:31 devstack sudo[112505]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.603s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:31 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:31 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Deleted volume successfully. Jun 19 04:34:31 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-54e4e26c-8995-45bb-a416-26d42f6a209c tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "cinder-a0be12ff-1618-4061-891d-9fb6cf2d2185-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:31 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Acquiring lock "cinder-4b88ed23-b817-4147-a475-0ca5d0f096b5-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:31 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "cinder-4b88ed23-b817-4147-a475-0ca5d0f096b5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:31 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Acquiring lock "cinder-quobyte-4b88ed23-b817-4147-a475-0ca5d0f096b5" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:31 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "cinder-quobyte-4b88ed23-b817-4147-a475-0ca5d0f096b5" acquired by "delete_volume" :: waited 0.013s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:31 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b26551d-53dd-4ac0-8e70-4352ea36671f]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:31 devstack sudo[112509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5 Jun 19 04:34:31 devstack sudo[112509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:31 devstack sudo[112509]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5" returned: 0 in 0.710s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:32 devstack sudo[112514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5 Jun 19 04:34:32 devstack sudo[112514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:32 devstack sudo[112514]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b88ed23-b817-4147-a475-0ca5d0f096b5" returned: 0 in 0.605s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:32 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "cinder-quobyte-4b88ed23-b817-4147-a475-0ca5d0f096b5" released by "delete_volume" :: held 1.350s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:32 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Created reservations ['31c05bb7-fafa-4281-a402-0328c0810c8f', '8e5ab10d-1271-43d0-94fe-fd5e9c340682', 'f0a4dd5f-7f62-422e-ba79-a63be7c09078', 'e69b42dc-1bd6-4e77-8a7d-cf18c2241c56'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:32 devstack sudo[112517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:34:32 devstack sudo[112517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:33 devstack sudo[112517]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.604s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:33 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:33 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Deleted volume successfully. Jun 19 04:34:33 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-53e6a9a7-f2cf-45ca-bbb7-6395c8fe4b6e tempest-TestServerVolumeAttachmentScenario-1352453279 None] Lock "cinder-4b88ed23-b817-4147-a475-0ca5d0f096b5-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:42 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:34:43 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=9,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:34:45 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Flow 'volume_create_manager' (e3da1e8c-e52f-4558-bff8-553c54aac04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:45 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979ab1a8-0fa4-4d5b-9d1a-dd27c94cc3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979ab1a8-0fa4-4d5b-9d1a-dd27c94cc3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9190f7-450c-4f5b-9a8c-232b64b42a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e854a4a1a9457cb77441d6457b03b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:46Z,use_quota=True,user_id='7295dcfe3f9c45be9c8e6eef1ec67369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b323b84-893a-405c-a66f-53173f9977ed),volume_type_id=1b323b84-893a-405c-a66f-53173f9977ed)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4643fb28-6841-411a-8d0c-fa26d455e066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4643fb28-6841-411a-8d0c-fa26d455e066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d5da8a-c115-48e9-8c6c-7a49fce82c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:46 devstack cinder-volume[93530]: DEBUG cinder.image.glance [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Creating Keystone auth plugin from conf {{(pid=93530) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:34:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d5da8a-c115-48e9-8c6c-7a49fce82c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e9190f7-450c-4f5b-9a8c-232b64b42a90', 'volume_name': 'volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90', 'volume_size': 1, 'image_id': '3b36a32e-0992-4822-99ad-97c514ed453d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b36a32e-0992-4822-99ad-97c514ed453d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f2bf8f0e4ad9b24096e2d0f55f9dd1a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79e854a4a1a9457cb77441d6457b03b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba5b7e1454976be4639deb1e8002509481c4690ac2c07e1767db4ad90e811e4de8072bc27a61ea2471e1c61a6f79cdcf1cdd0ee2ba56d96cb9a6bf6bba49fa8d', 'id': '3b36a32e-0992-4822-99ad-97c514ed453d', 'created_at': datetime.datetime(2026, 6, 19, 2, 34, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 34, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b36a32e-0992-4822-99ad-97c514ed453d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc795873-6d71-42d6-9307-ec3fba925218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc795873-6d71-42d6-9307-ec3fba925218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:46 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b7d21f-cfed-4c27-ae78-f2a72db2c64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:46 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Volume 3e9190f7-450c-4f5b-9a8c-232b64b42a90: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90', 'volume_size': 1, 'image_id': '3b36a32e-0992-4822-99ad-97c514ed453d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b36a32e-0992-4822-99ad-97c514ed453d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f2bf8f0e4ad9b24096e2d0f55f9dd1a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79e854a4a1a9457cb77441d6457b03b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba5b7e1454976be4639deb1e8002509481c4690ac2c07e1767db4ad90e811e4de8072bc27a61ea2471e1c61a6f79cdcf1cdd0ee2ba56d96cb9a6bf6bba49fa8d', 'id': '3b36a32e-0992-4822-99ad-97c514ed453d', 'created_at': datetime.datetime(2026, 6, 19, 2, 34, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 34, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b36a32e-0992-4822-99ad-97c514ed453d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 19 04:34:46 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Trying to clone 3e9190f7-450c-4f5b-9a8c-232b64b42a90 from image 3b36a32e-0992-4822-99ad-97c514ed453d at location (None, [{'url': 'file:///opt/stack/data/glance/images/3b36a32e-0992-4822-99ad-97c514ed453d', 'metadata': {}}]). {{(pid=93530) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:34:46 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:34:46 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Image download 0.00 MB at 0.00 MB/s Jun 19 04:34:46 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7505a3-1558-48de-b93f-8535375ac327]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:46 devstack sudo[112526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD Jun 19 04:34:46 devstack sudo[112526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:47 devstack sudo[112526]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD" returned: 0 in 0.684s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:47 devstack sudo[112530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD Jun 19 04:34:47 devstack sudo[112530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:47 devstack sudo[112530]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD" returned: 1 in 0.710s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:47 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Temporary image 3b36a32e-0992-4822-99ad-97c514ed453d is fetched for user 7295dcfe3f9c45be9c8e6eef1ec67369. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:34:47 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb32920-af7a-43d2-b133-ee380fb2c88b]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:47 devstack sudo[112572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD Jun 19 04:34:47 devstack sudo[112572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:48 devstack sudo[112572]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD" returned: 0 in 0.694s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:48 devstack sudo[112576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD Jun 19 04:34:48 devstack sudo[112576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:49 devstack sudo[112576]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD" returned: 1 in 0.680s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e9190f7-450c-4f5b-9a8c-232b64b42a90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79e854a4a1a9457cb77441d6457b03b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:46Z,use_quota=True,user_id='7295dcfe3f9c45be9c8e6eef1ec67369',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b323b84-893a-405c-a66f-53173f9977ed),volume_type_id=1b323b84-893a-405c-a66f-53173f9977ed)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Creating volume 3e9190f7-450c-4f5b-9a8c-232b64b42a90 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:49 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:34:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:49 devstack sudo[112581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 1073741824 Jun 19 04:34:49 devstack sudo[112581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:50 devstack sudo[112581]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 1073741824" returned: 0 in 0.754s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:50 devstack sudo[112586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 Jun 19 04:34:50 devstack sudo[112586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:50 devstack sudo[112586]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90" returned: 0 in 0.617s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:50 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:50 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Attempting download of 3b36a32e-0992-4822-99ad-97c514ed453d ((None, [{'url': 'file:///opt/stack/data/glance/images/3b36a32e-0992-4822-99ad-97c514ed453d', 'metadata': {}}])) to volume 3e9190f7-450c-4f5b-9a8c-232b64b42a90. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:34:50 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[358a32c1-23ab-47cb-b24b-a589518d46ce]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b36a32e-0992-4822-99ad-97c514ed453d__mz0z1qw {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:50 devstack sudo[112589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b36a32e-0992-4822-99ad-97c514ed453d__mz0z1qw Jun 19 04:34:50 devstack sudo[112589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:51 devstack sudo[112589]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b36a32e-0992-4822-99ad-97c514ed453d__mz0z1qw" returned: 0 in 0.683s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b36a32e-0992-4822-99ad-97c514ed453d__mz0z1qw {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:51 devstack sudo[112594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b36a32e-0992-4822-99ad-97c514ed453d__mz0z1qw Jun 19 04:34:51 devstack sudo[112594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:52 devstack sudo[112594]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b36a32e-0992-4822-99ad-97c514ed453d__mz0z1qw" returned: 1 in 0.682s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b36a32e-0992-4822-99ad-97c514ed453d__mz0z1qw' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:52 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba670284-844f-40b1-ace3-7b12a1857511]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:52 devstack sudo[112598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD Jun 19 04:34:52 devstack sudo[112598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:52 devstack sudo[112598]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD" returned: 0 in 0.682s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:52 devstack sudo[112602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD Jun 19 04:34:52 devstack sudo[112602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:53 devstack sudo[112602]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD" returned: 1 in 0.672s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:53 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] 3b36a32e-0992-4822-99ad-97c514ed453d was raw, converting to raw {{(pid=93530) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:34:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:53 devstack sudo[112607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 Jun 19 04:34:53 devstack sudo[112607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:54 devstack sudo[112607]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90" returned: 0 in 0.663s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:54 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3b36a32e-0992-4822-99ad-97c514ed453d_eni44sigdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:34:54 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Converted 0.00 MB image at 0.00 MB/s Jun 19 04:34:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:54 devstack sudo[112612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 1G Jun 19 04:34:54 devstack sudo[112612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:54 devstack sudo[112612]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 1G" returned: 0 in 0.656s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:54 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42187df-7827-4011-a0ad-31a6c935dfd6]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:54 devstack sudo[112617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 Jun 19 04:34:54 devstack sudo[112617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:55 devstack sudo[112617]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90" returned: 0 in 0.701s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:55 devstack sudo[112621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 Jun 19 04:34:55 devstack sudo[112621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:56 devstack sudo[112621]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90" returned: 1 in 0.723s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Downloaded image 3b36a32e-0992-4822-99ad-97c514ed453d ((None, [{'url': 'file:///opt/stack/data/glance/images/3b36a32e-0992-4822-99ad-97c514ed453d', 'metadata': {}}])) to volume 3e9190f7-450c-4f5b-9a8c-232b64b42a90 successfully. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Temporary image 3b36a32e-0992-4822-99ad-97c514ed453d for user 7295dcfe3f9c45be9c8e6eef1ec67369 is deleted. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Marking volume 3e9190f7-450c-4f5b-9a8c-232b64b42a90 as bootable. {{(pid=93530) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Copying metadata from image 3b36a32e-0992-4822-99ad-97c514ed453d to 3e9190f7-450c-4f5b-9a8c-232b64b42a90. {{(pid=93530) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Creating volume glance metadata for volume 3e9190f7-450c-4f5b-9a8c-232b64b42a90 backed by image 3b36a32e-0992-4822-99ad-97c514ed453d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3b36a32e-0992-4822-99ad-97c514ed453d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3f2bf8f0e4ad9b24096e2d0f55f9dd1a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93530) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b7d21f-cfed-4c27-ae78-f2a72db2c64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90', 'volume_size': 1, 'image_id': '3b36a32e-0992-4822-99ad-97c514ed453d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b36a32e-0992-4822-99ad-97c514ed453d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3f2bf8f0e4ad9b24096e2d0f55f9dd1a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79e854a4a1a9457cb77441d6457b03b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba5b7e1454976be4639deb1e8002509481c4690ac2c07e1767db4ad90e811e4de8072bc27a61ea2471e1c61a6f79cdcf1cdd0ee2ba56d96cb9a6bf6bba49fa8d', 'id': '3b36a32e-0992-4822-99ad-97c514ed453d', 'created_at': datetime.datetime(2026, 6, 19, 2, 34, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 34, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b36a32e-0992-4822-99ad-97c514ed453d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1860c06f-f561-4583-af75-3119c9783817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:56 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Volume volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 (3e9190f7-450c-4f5b-9a8c-232b64b42a90): created successfully Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1860c06f-f561-4583-af75-3119c9783817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Flow 'volume_create_manager' (e3da1e8c-e52f-4558-bff8-553c54aac04e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:56 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-24a4532e-aafe-492f-bb44-0c3a07cbac16 tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Created volume successfully. Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Acquiring lock "cinder-3e9190f7-450c-4f5b-9a8c-232b64b42a90-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Lock "cinder-3e9190f7-450c-4f5b-9a8c-232b64b42a90-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Acquiring lock "cinder-quobyte-3e9190f7-450c-4f5b-9a8c-232b64b42a90" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Lock "cinder-quobyte-3e9190f7-450c-4f5b-9a8c-232b64b42a90" acquired by "delete_volume" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f09849-2f5e-4c68-b5ab-ccee35e3cb8e]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:56 devstack sudo[112626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 Jun 19 04:34:56 devstack sudo[112626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:57 devstack sudo[112626]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90" returned: 0 in 0.697s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:57 devstack sudo[112630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 Jun 19 04:34:57 devstack sudo[112630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:58 devstack sudo[112630]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90" returned: 1 in 0.737s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:58 devstack sudo[112635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90 Jun 19 04:34:58 devstack sudo[112635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:58 devstack sudo[112635]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3e9190f7-450c-4f5b-9a8c-232b64b42a90" returned: 0 in 0.600s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Lock "cinder-quobyte-3e9190f7-450c-4f5b-9a8c-232b64b42a90" released by "delete_volume" :: held 2.091s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:58 devstack cinder-volume[93530]: WARNING cinder.quota [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:34:58 devstack cinder-volume[93530]: WARNING cinder.quota [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Created reservations ['a0d9b688-ad84-4cef-998e-1ebe107de331', 'b92b45f9-9ba9-4517-bb3e-ab2e5f6925fe', '2bd8fa76-3a57-4e7b-b3e6-67b012b540fa', '59cab8a1-c324-4659-abfc-1904538397c5'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:58 devstack sudo[112638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:34:58 devstack sudo[112638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:58 devstack sudo[112640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:34:58 devstack sudo[112640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:59 devstack sudo[112638]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.601s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:59 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Deleted volume successfully. Jun 19 04:34:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ad9143cd-b74f-452d-b976-24d33dbeb10d tempest-VolumeAndVolumeTypeFromImageTest-954761132 None] Lock "cinder-3e9190f7-450c-4f5b-9a8c-232b64b42a90-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:59 devstack sudo[112640]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.649s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:34:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:34:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Flow 'volume_create_manager' (c7c9d639-152f-4e93-9141-8251e1854c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1923837-f8c3-4fb4-aeb9-d7f2e1c84d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1923837-f8c3-4fb4-aeb9-d7f2e1c84d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1965232090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3818e6d0-331b-4ca2-a1ef-02d11da6f1f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ffa69778ac41968396d6679dea3c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:04Z,use_quota=True,user_id='ed4918b8ff8e40348d81c8af27d5f202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f437da2e-331c-4498-b473-5bce9bc8e192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f437da2e-331c-4498-b473-5bce9bc8e192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9774bb8-69ab-456e-820b-02db29442a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9774bb8-69ab-456e-820b-02db29442a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3818e6d0-331b-4ca2-a1ef-02d11da6f1f6', 'volume_name': 'volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa586119-4587-4e31-9c09-9dc8d01933c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa586119-4587-4e31-9c09-9dc8d01933c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa7389a-0e91-42a2-bad2-7258a3fa5686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:03 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Volume 3818e6d0-331b-4ca2-a1ef-02d11da6f1f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6', 'volume_size': 1} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1965232090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3818e6d0-331b-4ca2-a1ef-02d11da6f1f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ffa69778ac41968396d6679dea3c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:04Z,use_quota=True,user_id='ed4918b8ff8e40348d81c8af27d5f202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Creating volume 3818e6d0-331b-4ca2-a1ef-02d11da6f1f6 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:03 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:03 devstack sudo[112648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6 1073741824 Jun 19 04:35:03 devstack sudo[112648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Flow 'volume_create_manager' (82b16d46-94fd-4906-a294-ed2b0c078871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77681bea-bbef-47b5-b0bd-c39e7c3a69e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77681bea-bbef-47b5-b0bd-c39e7c3a69e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-429493875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d895b08c-2765-43c2-a617-0cf9b6c029b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ffa69778ac41968396d6679dea3c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:04Z,use_quota=True,user_id='ed4918b8ff8e40348d81c8af27d5f202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e348e8-ee22-4a61-af90-786eacdce3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40e348e8-ee22-4a61-af90-786eacdce3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61447537-9d79-455f-9a3f-484d0c8cc381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61447537-9d79-455f-9a3f-484d0c8cc381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd895b08c-2765-43c2-a617-0cf9b6c029b2', 'volume_name': 'volume-d895b08c-2765-43c2-a617-0cf9b6c029b2', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def17213-e905-4a17-9674-839bbbabcabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def17213-e905-4a17-9674-839bbbabcabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbf37ad-c627-481e-b439-b4bb4ab57448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Volume d895b08c-2765-43c2-a617-0cf9b6c029b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d895b08c-2765-43c2-a617-0cf9b6c029b2', 'volume_size': 1} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Flow 'volume_create_manager' (f46b4a60-9c4e-4bb2-b7e7-cc798ae87dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696c0831-008a-4fb9-b964-adc319745dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696c0831-008a-4fb9-b964-adc319745dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-221748251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ffa69778ac41968396d6679dea3c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:04Z,use_quota=True,user_id='ed4918b8ff8e40348d81c8af27d5f202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53492c55-cd20-4ea9-b617-3b39e4d346b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53492c55-cd20-4ea9-b617-3b39e4d346b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e757bb8e-1f79-4aa2-b4e7-4b82b985e692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e757bb8e-1f79-4aa2-b4e7-4b82b985e692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b', 'volume_name': 'volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d7d08d-9c71-4133-96fe-5a76b46df55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d7d08d-9c71-4133-96fe-5a76b46df55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a937c79c-4cc3-41c6-a6ee-7ac008dee94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Volume d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b', 'volume_size': 1} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:04 devstack sudo[112648]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6 1073741824" returned: 0 in 0.946s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:04 devstack sudo[112654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6 Jun 19 04:35:04 devstack sudo[112654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Flow 'volume_create_manager' (789934a4-ce42-434b-8046-c504628b87a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0b16dd-9736-4cb8-b8d4-1734f94baff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0b16dd-9736-4cb8-b8d4-1734f94baff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-264352022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ee56b8-f9f3-409c-b342-6283e2589747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ffa69778ac41968396d6679dea3c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:05Z,use_quota=True,user_id='ed4918b8ff8e40348d81c8af27d5f202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0082d48-4fa9-4a65-a033-9c52325a1c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0082d48-4fa9-4a65-a033-9c52325a1c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed36f18c-a3e1-4dd8-8c5e-207134c59f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed36f18c-a3e1-4dd8-8c5e-207134c59f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07ee56b8-f9f3-409c-b342-6283e2589747', 'volume_name': 'volume-07ee56b8-f9f3-409c-b342-6283e2589747', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c8651a-ba5f-4cfd-a9ec-a4bdf7383330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c8651a-ba5f-4cfd-a9ec-a4bdf7383330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efab70a-45fa-47be-99d0-0f674472bbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Volume 07ee56b8-f9f3-409c-b342-6283e2589747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07ee56b8-f9f3-409c-b342-6283e2589747', 'volume_size': 1} Jun 19 04:35:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Flow 'volume_create_manager' (040a6337-b254-4513-95c6-a45678a88604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5ce9b9-38f2-463f-9392-b7616952a746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5ce9b9-38f2-463f-9392-b7616952a746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1936672402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e460ac7-8421-4b8e-8cdb-3e8c48f7e315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ffa69778ac41968396d6679dea3c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:05Z,use_quota=True,user_id='ed4918b8ff8e40348d81c8af27d5f202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1718f6e8-0a81-4854-9a03-0a8cde513cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1718f6e8-0a81-4854-9a03-0a8cde513cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c55ff0c-09db-42ee-81d9-fa28673fffc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c55ff0c-09db-42ee-81d9-fa28673fffc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e460ac7-8421-4b8e-8cdb-3e8c48f7e315', 'volume_name': 'volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eff2fec-210d-4d28-a4af-e136882e3948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eff2fec-210d-4d28-a4af-e136882e3948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee38bf9-b1fa-4175-8e9a-e079bc699b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:05 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Volume 0e460ac7-8421-4b8e-8cdb-3e8c48f7e315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315', 'volume_size': 1} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:05 devstack sudo[112654]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6" returned: 0 in 0.647s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.273s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-429493875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d895b08c-2765-43c2-a617-0cf9b6c029b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ffa69778ac41968396d6679dea3c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:04Z,use_quota=True,user_id='ed4918b8ff8e40348d81c8af27d5f202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Creating volume d895b08c-2765-43c2-a617-0cf9b6c029b2 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:05 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d895b08c-2765-43c2-a617-0cf9b6c029b2 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa7389a-0e91-42a2-bad2-7258a3fa5686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:05 devstack sudo[112657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d895b08c-2765-43c2-a617-0cf9b6c029b2 1073741824 Jun 19 04:35:05 devstack sudo[112657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d258af37-74d4-417b-be57-e464572841b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:05 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Volume volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6 (3818e6d0-331b-4ca2-a1ef-02d11da6f1f6): created successfully Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d258af37-74d4-417b-be57-e464572841b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Flow 'volume_create_manager' (c7c9d639-152f-4e93-9141-8251e1854c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:05 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-acb169d1-0eab-425d-8905-1ada531fbb40 tempest-CreateVolumesFromImageTest-1629683661 None] Created volume successfully. Jun 19 04:35:06 devstack sudo[112657]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d895b08c-2765-43c2-a617-0cf9b6c029b2 1073741824" returned: 0 in 0.809s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d895b08c-2765-43c2-a617-0cf9b6c029b2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:06 devstack sudo[112665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d895b08c-2765-43c2-a617-0cf9b6c029b2 Jun 19 04:35:06 devstack sudo[112665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:06 devstack sudo[112665]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d895b08c-2765-43c2-a617-0cf9b6c029b2" returned: 0 in 0.613s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.362s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-221748251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ffa69778ac41968396d6679dea3c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:04Z,use_quota=True,user_id='ed4918b8ff8e40348d81c8af27d5f202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Creating volume d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:06 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:06 devstack sudo[112668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b 1073741824 Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbbf37ad-c627-481e-b439-b4bb4ab57448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d895b08c-2765-43c2-a617-0cf9b6c029b2', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:06 devstack sudo[112668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ae2690-256a-4335-9a8e-ce569938785d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:06 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Volume volume-d895b08c-2765-43c2-a617-0cf9b6c029b2 (d895b08c-2765-43c2-a617-0cf9b6c029b2): created successfully Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17ae2690-256a-4335-9a8e-ce569938785d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:06 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Flow 'volume_create_manager' (82b16d46-94fd-4906-a294-ed2b0c078871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:06 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-741b58ed-6ea1-46fe-b7be-27da3ede6099 tempest-CreateVolumesFromImageTest-1629683661 None] Created volume successfully. Jun 19 04:35:07 devstack sudo[112668]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b 1073741824" returned: 0 in 0.764s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:07 devstack sudo[112675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b Jun 19 04:35:07 devstack sudo[112675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:08 devstack sudo[112675]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b" returned: 0 in 0.603s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.394s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-264352022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07ee56b8-f9f3-409c-b342-6283e2589747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ffa69778ac41968396d6679dea3c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:05Z,use_quota=True,user_id='ed4918b8ff8e40348d81c8af27d5f202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Creating volume 07ee56b8-f9f3-409c-b342-6283e2589747 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:08 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-07ee56b8-f9f3-409c-b342-6283e2589747 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a937c79c-4cc3-41c6-a6ee-7ac008dee94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:08 devstack sudo[112678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-07ee56b8-f9f3-409c-b342-6283e2589747 1073741824 Jun 19 04:35:08 devstack sudo[112678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fcf773d-3c5c-4da3-b795-54c3b696d5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:08 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Volume volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b (d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b): created successfully Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fcf773d-3c5c-4da3-b795-54c3b696d5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Flow 'volume_create_manager' (f46b4a60-9c4e-4bb2-b7e7-cc798ae87dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:08 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-764c9fd3-ce52-4e66-8fec-24ba904f8910 tempest-CreateVolumesFromImageTest-1629683661 None] Created volume successfully. Jun 19 04:35:08 devstack sudo[112678]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-07ee56b8-f9f3-409c-b342-6283e2589747 1073741824" returned: 0 in 0.763s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-07ee56b8-f9f3-409c-b342-6283e2589747 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:09 devstack sudo[112684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-07ee56b8-f9f3-409c-b342-6283e2589747 Jun 19 04:35:09 devstack sudo[112684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:09 devstack sudo[112684]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-07ee56b8-f9f3-409c-b342-6283e2589747" returned: 0 in 0.671s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.500s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1936672402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e460ac7-8421-4b8e-8cdb-3e8c48f7e315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ffa69778ac41968396d6679dea3c3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:05Z,use_quota=True,user_id='ed4918b8ff8e40348d81c8af27d5f202',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Creating volume 0e460ac7-8421-4b8e-8cdb-3e8c48f7e315 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:09 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efab70a-45fa-47be-99d0-0f674472bbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07ee56b8-f9f3-409c-b342-6283e2589747', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:09 devstack sudo[112687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315 1073741824 Jun 19 04:35:09 devstack sudo[112687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2dbe680-13dd-4b65-855f-aa492624a0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:09 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Volume volume-07ee56b8-f9f3-409c-b342-6283e2589747 (07ee56b8-f9f3-409c-b342-6283e2589747): created successfully Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2dbe680-13dd-4b65-855f-aa492624a0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Flow 'volume_create_manager' (789934a4-ce42-434b-8046-c504628b87a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:09 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-14b6e11f-e129-466b-a48a-3aa1b1fa5e7b tempest-CreateVolumesFromImageTest-1629683661 None] Created volume successfully. Jun 19 04:35:10 devstack sudo[112687]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315 1073741824" returned: 0 in 0.839s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:10 devstack sudo[112695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315 Jun 19 04:35:10 devstack sudo[112695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:11 devstack sudo[112695]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315" returned: 0 in 0.621s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee38bf9-b1fa-4175-8e9a-e079bc699b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2b510e-cdd6-4ad0-9b0c-73781295772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:11 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Volume volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315 (0e460ac7-8421-4b8e-8cdb-3e8c48f7e315): created successfully Jun 19 04:35:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec2b510e-cdd6-4ad0-9b0c-73781295772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Flow 'volume_create_manager' (040a6337-b254-4513-95c6-a45678a88604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:11 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-23b4d06e-e3b1-428c-a224-17e7e5bba27f tempest-CreateVolumesFromImageTest-1629683661 None] Created volume successfully. Jun 19 04:35:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "cinder-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "cinder-quobyte-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-quobyte-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315" acquired by "delete_volume" :: waited 0.013s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:11 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[837717d9-34c9-4f73-8ca9-839b8013c937]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:11 devstack sudo[112699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315 Jun 19 04:35:11 devstack sudo[112699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:12 devstack sudo[112699]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315" returned: 0 in 0.717s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:12 devstack sudo[112704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315 Jun 19 04:35:12 devstack sudo[112704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:13 devstack sudo[112704]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315" returned: 0 in 0.609s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-quobyte-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315" released by "delete_volume" :: held 1.367s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Created reservations ['59c6ab30-cd88-4434-9cdc-4bb7b11adcb9', 'e8473a05-666e-4741-aa7b-e57b08f7f8de', '2d79c363-0f2f-4bfc-a553-ce498cef8e48', 'c9dfb098-4791-4697-a093-e71f03622522'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:13 devstack sudo[112707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:35:13 devstack sudo[112707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:13 devstack sudo[112707]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.603s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:13 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Deleted volume successfully. Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-24479b1c-3e78-47bd-ae72-19efa7def5c1 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-0e460ac7-8421-4b8e-8cdb-3e8c48f7e315-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "cinder-07ee56b8-f9f3-409c-b342-6283e2589747-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-07ee56b8-f9f3-409c-b342-6283e2589747-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "cinder-quobyte-07ee56b8-f9f3-409c-b342-6283e2589747" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-quobyte-07ee56b8-f9f3-409c-b342-6283e2589747" acquired by "delete_volume" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49b4885-8f5a-4624-b1c1-5b23f151d5b6]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-07ee56b8-f9f3-409c-b342-6283e2589747 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:14 devstack sudo[112710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-07ee56b8-f9f3-409c-b342-6283e2589747 Jun 19 04:35:14 devstack sudo[112710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:14 devstack sudo[112710]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-07ee56b8-f9f3-409c-b342-6283e2589747" returned: 0 in 0.706s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-07ee56b8-f9f3-409c-b342-6283e2589747 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:14 devstack sudo[112715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-07ee56b8-f9f3-409c-b342-6283e2589747 Jun 19 04:35:14 devstack sudo[112715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:15 devstack sudo[112715]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-07ee56b8-f9f3-409c-b342-6283e2589747" returned: 0 in 0.608s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-quobyte-07ee56b8-f9f3-409c-b342-6283e2589747" released by "delete_volume" :: held 1.352s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:15 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Created reservations ['517f753b-db07-4007-87b8-96f25b6b382b', 'fb630b2a-76a8-4f1c-90fc-91547fff1fdb', '183cc7b9-7015-4296-87b2-b5e258f1ca82', '392ccf4c-b0e5-4fc9-bbe2-40c661dc52cf'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:15 devstack sudo[112718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:35:15 devstack sudo[112718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:15 devstack sudo[112718]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.601s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:15 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Deleted volume successfully. Jun 19 04:35:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-db0894d4-dfdb-4dbf-8b57-90f1345477c9 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-07ee56b8-f9f3-409c-b342-6283e2589747-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "cinder-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "cinder-quobyte-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:16 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-quobyte-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b" acquired by "delete_volume" :: waited 0.015s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:16 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a9f686-8009-4cde-8df3-5cd2f6732bcc]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:16 devstack sudo[112721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b Jun 19 04:35:16 devstack sudo[112721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:16 devstack sudo[112721]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b" returned: 0 in 0.716s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:16 devstack sudo[112726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b Jun 19 04:35:16 devstack sudo[112726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:17 devstack sudo[112726]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b" returned: 0 in 0.618s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-quobyte-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b" released by "delete_volume" :: held 1.371s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:17 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Created reservations ['3ea56779-44c6-4d18-9294-61b00e44d670', 'ecb1bef1-e0a9-4294-bb08-1e497c424a99', 'bb43c224-b873-46ce-818d-7b3153d6476f', '2ce571b0-a6bb-461f-8d48-caba4406443c'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:17 devstack sudo[112729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:35:17 devstack sudo[112729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:18 devstack sudo[112729]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.634s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:18 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:18 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Deleted volume successfully. Jun 19 04:35:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-dbdfc6bb-1710-4def-afbe-481a8f2cb83a tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-d6f4c1c7-90d6-49e8-a2c5-9f8e0d1d190b-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "cinder-d895b08c-2765-43c2-a617-0cf9b6c029b2-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-d895b08c-2765-43c2-a617-0cf9b6c029b2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "cinder-quobyte-d895b08c-2765-43c2-a617-0cf9b6c029b2" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-quobyte-d895b08c-2765-43c2-a617-0cf9b6c029b2" acquired by "delete_volume" :: waited 0.013s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:18 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d99acd3-a1d6-4782-b2c1-9e9d1075039d]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d895b08c-2765-43c2-a617-0cf9b6c029b2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:18 devstack sudo[112732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d895b08c-2765-43c2-a617-0cf9b6c029b2 Jun 19 04:35:18 devstack sudo[112732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:19 devstack sudo[112732]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d895b08c-2765-43c2-a617-0cf9b6c029b2" returned: 0 in 0.720s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d895b08c-2765-43c2-a617-0cf9b6c029b2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:19 devstack sudo[112738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d895b08c-2765-43c2-a617-0cf9b6c029b2 Jun 19 04:35:19 devstack sudo[112738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:19 devstack sudo[112738]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d895b08c-2765-43c2-a617-0cf9b6c029b2" returned: 0 in 0.608s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-quobyte-d895b08c-2765-43c2-a617-0cf9b6c029b2" released by "delete_volume" :: held 1.362s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:19 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Created reservations ['5f320ec6-583c-4bcf-b9d2-191a15cdec91', '52900e7d-c5f7-4008-94c4-2d9c34c86ee3', '11ca7f96-ba81-48f4-a4b4-32321077e731', 'ecc57568-98cb-43f2-9e45-2d2e52d3bccd'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:19 devstack sudo[112741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:35:19 devstack sudo[112741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:20 devstack sudo[112741]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.620s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:20 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:20 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Deleted volume successfully. Jun 19 04:35:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94b4cb7d-ba78-4854-af17-38b0c8022ba7 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-d895b08c-2765-43c2-a617-0cf9b6c029b2-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "cinder-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "cinder-quobyte-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-quobyte-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6" acquired by "delete_volume" :: waited 0.014s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:20 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f140290-018c-4fb8-94eb-b0fc0b5f6fcf]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:20 devstack sudo[112744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6 Jun 19 04:35:20 devstack sudo[112744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:21 devstack sudo[112744]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6" returned: 0 in 0.719s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:21 devstack sudo[112750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6 Jun 19 04:35:21 devstack sudo[112750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:21 devstack sudo[112750]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6" returned: 0 in 0.645s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-quobyte-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6" released by "delete_volume" :: held 1.400s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:22 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Created reservations ['6a0da9de-c63d-4f75-8850-9db15f678fa9', 'fcd06314-b020-482d-9e1b-451770c24b4e', '977ab463-516a-4b1b-aede-694da575c71f', '6070e374-9ebf-48bd-b343-635152cc4221'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:22 devstack sudo[112753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:35:22 devstack sudo[112753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:22 devstack sudo[112753]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.645s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:22 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:22 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Deleted volume successfully. Jun 19 04:35:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-32459d3b-b5c7-41af-8e8c-d34eee4e71f0 tempest-CreateVolumesFromImageTest-1629683661 None] Lock "cinder-3818e6d0-331b-4ca2-a1ef-02d11da6f1f6-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Flow 'volume_create_manager' (0145472d-bf9c-4d65-9a7d-1630de2ef297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2548da8a-0c5c-481e-bab3-dd8c51674cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2548da8a-0c5c-481e-bab3-dd8c51674cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1712017258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fde79cc-a80d-4b7c-9871-2af01d142e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d311b7a8c44df8bef7db0e0697c6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:25Z,use_quota=True,user_id='7509971932fb41738c2903ff4eb824a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e08de3-00e3-4b29-b84e-32f8ee2bb485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e08de3-00e3-4b29-b84e-32f8ee2bb485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01d4aa3-ce1e-4555-9e35-d66e9fcd123b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01d4aa3-ce1e-4555-9e35-d66e9fcd123b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fde79cc-a80d-4b7c-9871-2af01d142e7b', 'volume_name': 'volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2239f5-1286-418e-99d4-6b3a95e17413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2239f5-1286-418e-99d4-6b3a95e17413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd79030-74b7-4f93-8fe7-ac6faa31806b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:25 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume 1fde79cc-a80d-4b7c-9871-2af01d142e7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b', 'volume_size': 1} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1712017258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fde79cc-a80d-4b7c-9871-2af01d142e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d311b7a8c44df8bef7db0e0697c6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:25Z,use_quota=True,user_id='7509971932fb41738c2903ff4eb824a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Creating volume 1fde79cc-a80d-4b7c-9871-2af01d142e7b {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:25 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:35:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:25 devstack sudo[112763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b 1073741824 Jun 19 04:35:25 devstack sudo[112763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:26 devstack sudo[112763]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b 1073741824" returned: 0 in 0.771s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:26 devstack sudo[112769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b Jun 19 04:35:26 devstack sudo[112769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:26 devstack sudo[112769]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b" returned: 0 in 0.621s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd79030-74b7-4f93-8fe7-ac6faa31806b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c55a9f9-25e0-472a-b845-812c4c497abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:26 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b (1fde79cc-a80d-4b7c-9871-2af01d142e7b): created successfully Jun 19 04:35:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c55a9f9-25e0-472a-b845-812c4c497abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Flow 'volume_create_manager' (0145472d-bf9c-4d65-9a7d-1630de2ef297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:26 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-05234977-a053-4eb2-b3b1-34b0f0780af8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Created volume successfully. Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Flow 'volume_create_manager' (6d5eb79d-e04c-4f94-9188-81f557d3372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e510b733-6886-4a77-ae81-67a6d8ed2c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e510b733-6886-4a77-ae81-67a6d8ed2c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1845437426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d311b7a8c44df8bef7db0e0697c6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:28Z,use_quota=True,user_id='7509971932fb41738c2903ff4eb824a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d4be64-5296-4eeb-9561-79dff1eee7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d4be64-5296-4eeb-9561-79dff1eee7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66003360-7aa6-4970-8f91-0faddc0a7b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66003360-7aa6-4970-8f91-0faddc0a7b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b', 'volume_name': 'volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b54498d-2595-454c-b0f5-217fe107432d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b54498d-2595-454c-b0f5-217fe107432d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa78464-c649-42ce-82f7-ff1a5b65aded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:27 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b', 'volume_size': 1} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1845437426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d311b7a8c44df8bef7db0e0697c6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:28Z,use_quota=True,user_id='7509971932fb41738c2903ff4eb824a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Creating volume d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:27 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:35:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:27 devstack sudo[112774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b 1073741824 Jun 19 04:35:27 devstack sudo[112774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Flow 'volume_create_manager' (856b15c1-971b-48db-b969-6b8ac33c0f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e03fb5d-14b2-4da9-8ce6-ab35d7db545f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e03fb5d-14b2-4da9-8ce6-ab35d7db545f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1168420934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8460cd-97be-4e40-a893-0a698cfe2ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d311b7a8c44df8bef7db0e0697c6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:28Z,use_quota=True,user_id='7509971932fb41738c2903ff4eb824a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba87e201-26e1-4871-af24-f5b581c08c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba87e201-26e1-4871-af24-f5b581c08c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22bd126-c226-4fe3-baf4-9f93a4c015d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22bd126-c226-4fe3-baf4-9f93a4c015d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b8460cd-97be-4e40-a893-0a698cfe2ca2', 'volume_name': 'volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2007137d-f0bc-401a-9302-9f24a209434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2007137d-f0bc-401a-9302-9f24a209434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a10c253-af62-4c99-a2dc-ce9fc905d9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:28 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume 6b8460cd-97be-4e40-a893-0a698cfe2ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2', 'volume_size': 1} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Flow 'volume_create_manager' (2da296d4-fce9-4640-9300-78dd2260973d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9b62ea-7b04-4551-a9f7-d168acacfcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd9b62ea-7b04-4551-a9f7-d168acacfcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-883993531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b6680c-102e-427b-b260-6f960ce709b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d311b7a8c44df8bef7db0e0697c6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:28Z,use_quota=True,user_id='7509971932fb41738c2903ff4eb824a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65bdf32-53f0-4f15-9b20-0cb51b5cfd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65bdf32-53f0-4f15-9b20-0cb51b5cfd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b37095-ead0-4030-a59b-450fba794c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b37095-ead0-4030-a59b-450fba794c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b6680c-102e-427b-b260-6f960ce709b9', 'volume_name': 'volume-81b6680c-102e-427b-b260-6f960ce709b9', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a5eeea-eaea-4d6f-b953-b7968f1b4e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a5eeea-eaea-4d6f-b953-b7968f1b4e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf55b55-67b2-43fe-9bde-e3d035409c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:28 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume 81b6680c-102e-427b-b260-6f960ce709b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b6680c-102e-427b-b260-6f960ce709b9', 'volume_size': 1} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:28 devstack sudo[112774]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b 1073741824" returned: 0 in 0.982s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:28 devstack sudo[112780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b Jun 19 04:35:28 devstack sudo[112780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Flow 'volume_create_manager' (f8d2b780-951f-40d4-b003-bd5d731a8bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c2ccb6-aea0-4a77-9a81-71dfe2f708ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59c2ccb6-aea0-4a77-9a81-71dfe2f708ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1868298467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8668e001-3df3-47ae-b424-9767e67fb420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d311b7a8c44df8bef7db0e0697c6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:29Z,use_quota=True,user_id='7509971932fb41738c2903ff4eb824a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad97e6d8-44ed-49c4-a8f2-fb062b70ad7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad97e6d8-44ed-49c4-a8f2-fb062b70ad7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccbd1fb-6262-4644-b9b7-1bb12a7a0613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dccbd1fb-6262-4644-b9b7-1bb12a7a0613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8668e001-3df3-47ae-b424-9767e67fb420', 'volume_name': 'volume-8668e001-3df3-47ae-b424-9767e67fb420', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb580df-20b0-4cb7-8f29-c83ecbfc532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb580df-20b0-4cb7-8f29-c83ecbfc532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd194208-d970-45ac-b2f3-44dc88c239ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:29 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume 8668e001-3df3-47ae-b424-9767e67fb420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8668e001-3df3-47ae-b424-9767e67fb420', 'volume_size': 1} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Flow 'volume_create_manager' (fc9d5e06-1201-4f25-b402-1577fea71901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204972bc-c5cb-4f80-8e04-9e92f86ff054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204972bc-c5cb-4f80-8e04-9e92f86ff054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205555407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5200b137-5292-41a2-a431-07f40ebd99d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d311b7a8c44df8bef7db0e0697c6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:29Z,use_quota=True,user_id='7509971932fb41738c2903ff4eb824a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7929dfc-85e5-4ad8-98d6-2d1b847ac447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7929dfc-85e5-4ad8-98d6-2d1b847ac447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f89ad1-9028-49c3-9ee0-838eaeee6868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f89ad1-9028-49c3-9ee0-838eaeee6868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5200b137-5292-41a2-a431-07f40ebd99d2', 'volume_name': 'volume-5200b137-5292-41a2-a431-07f40ebd99d2', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea019d17-1fef-44be-ace4-9a1922dbcc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea019d17-1fef-44be-ace4-9a1922dbcc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523e187c-f3f6-4d5d-8635-126b1430425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:29 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume 5200b137-5292-41a2-a431-07f40ebd99d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5200b137-5292-41a2-a431-07f40ebd99d2', 'volume_size': 1} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:29 devstack sudo[112780]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b" returned: 0 in 0.701s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.339s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1168420934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8460cd-97be-4e40-a893-0a698cfe2ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d311b7a8c44df8bef7db0e0697c6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:28Z,use_quota=True,user_id='7509971932fb41738c2903ff4eb824a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Creating volume 6b8460cd-97be-4e40-a893-0a698cfe2ca2 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:29 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa78464-c649-42ce-82f7-ff1a5b65aded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:29 devstack sudo[112783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2 1073741824 Jun 19 04:35:29 devstack sudo[112783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49dd020f-ba17-4ea0-9c81-6d1fb89b40db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:29 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b (d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b): created successfully Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49dd020f-ba17-4ea0-9c81-6d1fb89b40db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Flow 'volume_create_manager' (6d5eb79d-e04c-4f94-9188-81f557d3372e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:29 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-175a90ee-a890-44ba-9aca-e23a5f7f90c3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Created volume successfully. Jun 19 04:35:30 devstack sudo[112783]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2 1073741824" returned: 0 in 0.843s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:30 devstack sudo[112789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2 Jun 19 04:35:30 devstack sudo[112789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:31 devstack sudo[112789]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2" returned: 0 in 0.681s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.561s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-883993531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b6680c-102e-427b-b260-6f960ce709b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d311b7a8c44df8bef7db0e0697c6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:28Z,use_quota=True,user_id='7509971932fb41738c2903ff4eb824a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Creating volume 81b6680c-102e-427b-b260-6f960ce709b9 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:31 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81b6680c-102e-427b-b260-6f960ce709b9 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:31 devstack sudo[112792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81b6680c-102e-427b-b260-6f960ce709b9 1073741824 Jun 19 04:35:31 devstack sudo[112792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a10c253-af62-4c99-a2dc-ce9fc905d9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b766b0f-8c50-4e2b-841b-e1b2a394b80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:31 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2 (6b8460cd-97be-4e40-a893-0a698cfe2ca2): created successfully Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b766b0f-8c50-4e2b-841b-e1b2a394b80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:31 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Flow 'volume_create_manager' (856b15c1-971b-48db-b969-6b8ac33c0f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:31 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-78467723-a85e-421d-8f52-b821c6d715e4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Created volume successfully. Jun 19 04:35:31 devstack sudo[112792]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81b6680c-102e-427b-b260-6f960ce709b9 1073741824" returned: 0 in 0.852s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81b6680c-102e-427b-b260-6f960ce709b9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:32 devstack sudo[112798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81b6680c-102e-427b-b260-6f960ce709b9 Jun 19 04:35:32 devstack sudo[112798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:32 devstack sudo[112798]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81b6680c-102e-427b-b260-6f960ce709b9" returned: 0 in 0.669s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.684s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1868298467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8668e001-3df3-47ae-b424-9767e67fb420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d311b7a8c44df8bef7db0e0697c6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:29Z,use_quota=True,user_id='7509971932fb41738c2903ff4eb824a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Creating volume 8668e001-3df3-47ae-b424-9767e67fb420 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:32 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8668e001-3df3-47ae-b424-9767e67fb420 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bf55b55-67b2-43fe-9bde-e3d035409c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b6680c-102e-427b-b260-6f960ce709b9', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:32 devstack sudo[112801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8668e001-3df3-47ae-b424-9767e67fb420 1073741824 Jun 19 04:35:32 devstack sudo[112801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01bb9416-216a-45a8-b910-865756d8abe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:32 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume volume-81b6680c-102e-427b-b260-6f960ce709b9 (81b6680c-102e-427b-b260-6f960ce709b9): created successfully Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01bb9416-216a-45a8-b910-865756d8abe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Flow 'volume_create_manager' (2da296d4-fce9-4640-9300-78dd2260973d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:32 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f3ad5da2-f96e-4e8f-a4e4-32c18b4a2071 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Created volume successfully. Jun 19 04:35:33 devstack sudo[112801]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8668e001-3df3-47ae-b424-9767e67fb420 1073741824" returned: 0 in 0.819s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8668e001-3df3-47ae-b424-9767e67fb420 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:33 devstack sudo[112806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8668e001-3df3-47ae-b424-9767e67fb420 Jun 19 04:35:33 devstack sudo[112806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:34 devstack sudo[112806]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8668e001-3df3-47ae-b424-9767e67fb420" returned: 0 in 0.616s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.847s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205555407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5200b137-5292-41a2-a431-07f40ebd99d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d311b7a8c44df8bef7db0e0697c6c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:29Z,use_quota=True,user_id='7509971932fb41738c2903ff4eb824a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Creating volume 5200b137-5292-41a2-a431-07f40ebd99d2 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:34 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5200b137-5292-41a2-a431-07f40ebd99d2 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd194208-d970-45ac-b2f3-44dc88c239ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8668e001-3df3-47ae-b424-9767e67fb420', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:34 devstack sudo[112809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5200b137-5292-41a2-a431-07f40ebd99d2 1073741824 Jun 19 04:35:34 devstack sudo[112809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df905d8-7833-4dfc-b17c-808153618429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:34 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume volume-8668e001-3df3-47ae-b424-9767e67fb420 (8668e001-3df3-47ae-b424-9767e67fb420): created successfully Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df905d8-7833-4dfc-b17c-808153618429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:34 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Flow 'volume_create_manager' (f8d2b780-951f-40d4-b003-bd5d731a8bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:34 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-307d9930-54a2-42ff-8858-a0d4f8e071f0 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Created volume successfully. Jun 19 04:35:35 devstack sudo[112809]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5200b137-5292-41a2-a431-07f40ebd99d2 1073741824" returned: 0 in 0.810s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5200b137-5292-41a2-a431-07f40ebd99d2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:35 devstack sudo[112815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5200b137-5292-41a2-a431-07f40ebd99d2 Jun 19 04:35:35 devstack sudo[112815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:35 devstack sudo[112815]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5200b137-5292-41a2-a431-07f40ebd99d2" returned: 0 in 0.619s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523e187c-f3f6-4d5d-8635-126b1430425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5200b137-5292-41a2-a431-07f40ebd99d2', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996cf808-3476-4aa0-afad-8f1a914423ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:35 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Volume volume-5200b137-5292-41a2-a431-07f40ebd99d2 (5200b137-5292-41a2-a431-07f40ebd99d2): created successfully Jun 19 04:35:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996cf808-3476-4aa0-afad-8f1a914423ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Flow 'volume_create_manager' (fc9d5e06-1201-4f25-b402-1577fea71901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:35 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-50fe29c6-01db-4556-bdb2-8b21783f28d3 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Created volume successfully. Jun 19 04:35:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "cinder-5200b137-5292-41a2-a431-07f40ebd99d2-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-5200b137-5292-41a2-a431-07f40ebd99d2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "cinder-quobyte-5200b137-5292-41a2-a431-07f40ebd99d2" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-quobyte-5200b137-5292-41a2-a431-07f40ebd99d2" acquired by "delete_volume" :: waited 0.014s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:36 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd90c24-dd10-473a-93d3-e95d5c1d984a]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5200b137-5292-41a2-a431-07f40ebd99d2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:37 devstack sudo[112818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5200b137-5292-41a2-a431-07f40ebd99d2 Jun 19 04:35:37 devstack sudo[112818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:37 devstack sudo[112818]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5200b137-5292-41a2-a431-07f40ebd99d2" returned: 0 in 0.737s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5200b137-5292-41a2-a431-07f40ebd99d2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:37 devstack sudo[112823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5200b137-5292-41a2-a431-07f40ebd99d2 Jun 19 04:35:37 devstack sudo[112823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:38 devstack sudo[112823]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5200b137-5292-41a2-a431-07f40ebd99d2" returned: 0 in 0.618s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-quobyte-5200b137-5292-41a2-a431-07f40ebd99d2" released by "delete_volume" :: held 1.391s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:38 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Created reservations ['bbb04ca4-5c59-422d-bd6a-24423740632b', '3406f3a1-84a2-48fa-9da4-e6aed0feb3df', 'a19f927b-3259-42aa-9ec1-27f58ccc4bfa', '3fcf99b1-674c-44a4-8640-2859d9295aa5'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:38 devstack sudo[112826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:35:38 devstack sudo[112826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:39 devstack sudo[112826]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.624s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:39 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:39 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Deleted volume successfully. Jun 19 04:35:39 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "cinder-8668e001-3df3-47ae-b424-9767e67fb420-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:39 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-bb3f66b3-074c-45cb-be2a-71a30b4d2267 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-5200b137-5292-41a2-a431-07f40ebd99d2-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:39 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-8668e001-3df3-47ae-b424-9767e67fb420-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:39 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "cinder-quobyte-8668e001-3df3-47ae-b424-9767e67fb420" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:39 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-quobyte-8668e001-3df3-47ae-b424-9767e67fb420" acquired by "delete_volume" :: waited 0.013s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:39 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[d891fc3f-a466-4663-bca5-d3672e348eba]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8668e001-3df3-47ae-b424-9767e67fb420 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:39 devstack sudo[112829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8668e001-3df3-47ae-b424-9767e67fb420 Jun 19 04:35:39 devstack sudo[112829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:39 devstack sudo[112829]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8668e001-3df3-47ae-b424-9767e67fb420" returned: 0 in 0.756s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8668e001-3df3-47ae-b424-9767e67fb420 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:39 devstack sudo[112834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8668e001-3df3-47ae-b424-9767e67fb420 Jun 19 04:35:39 devstack sudo[112834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:40 devstack sudo[112834]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8668e001-3df3-47ae-b424-9767e67fb420" returned: 0 in 0.636s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-quobyte-8668e001-3df3-47ae-b424-9767e67fb420" released by "delete_volume" :: held 1.429s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:40 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Created reservations ['0ee32fde-033c-4a31-90fd-d5a2962788e0', '76ddb9ad-e22c-4b5a-8683-084eb89b3200', 'de01b21b-7c3a-42a3-b704-3170973ab0fe', '7e2927b1-3769-490c-929d-8c3a24f7fd31'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:40 devstack sudo[112837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:35:40 devstack sudo[112837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "cinder-81b6680c-102e-427b-b260-6f960ce709b9-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:41 devstack sudo[112837]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.628s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:41 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-81b6680c-102e-427b-b260-6f960ce709b9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:41 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Deleted volume successfully. Jun 19 04:35:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8e36c743-db9d-4213-87b6-a78e618219b8 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-8668e001-3df3-47ae-b424-9767e67fb420-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "cinder-quobyte-81b6680c-102e-427b-b260-6f960ce709b9" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-quobyte-81b6680c-102e-427b-b260-6f960ce709b9" acquired by "delete_volume" :: waited 0.014s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:41 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[841f487a-406e-4612-99c5-4debcec6c881]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81b6680c-102e-427b-b260-6f960ce709b9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:41 devstack sudo[112841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81b6680c-102e-427b-b260-6f960ce709b9 Jun 19 04:35:41 devstack sudo[112841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:42 devstack sudo[112841]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81b6680c-102e-427b-b260-6f960ce709b9" returned: 0 in 0.779s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81b6680c-102e-427b-b260-6f960ce709b9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:42 devstack sudo[112846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81b6680c-102e-427b-b260-6f960ce709b9 Jun 19 04:35:42 devstack sudo[112846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:42 devstack sudo[112846]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81b6680c-102e-427b-b260-6f960ce709b9" returned: 0 in 0.620s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-quobyte-81b6680c-102e-427b-b260-6f960ce709b9" released by "delete_volume" :: held 1.438s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:42 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=70,cinder:UPDATE=110,cinder:INSERT=26,cinder:DELETE=13 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:35:42 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Created reservations ['6770f077-82a3-4e32-a03d-46d44d70423e', '4a932df1-3681-430a-a3dc-8b9991d153e1', 'df40cc6b-f3c0-4d16-9c26-5788b1a10878', 'cf80e4ba-aa0c-4ef7-ac29-0fa01ed40164'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:42 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:42 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:42 devstack sudo[112849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:35:42 devstack sudo[112849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "cinder-6b8460cd-97be-4e40-a893-0a698cfe2ca2-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:43 devstack sudo[112849]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.636s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:43 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-6b8460cd-97be-4e40-a893-0a698cfe2ca2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:43 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Deleted volume successfully. Jun 19 04:35:43 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=102,cinder:SELECT=78,cinder:INSERT=30,cinder:DELETE=8 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:35:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6feac1eb-a7eb-4ce2-86ad-b24cf675c819 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-81b6680c-102e-427b-b260-6f960ce709b9-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "cinder-quobyte-6b8460cd-97be-4e40-a893-0a698cfe2ca2" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-quobyte-6b8460cd-97be-4e40-a893-0a698cfe2ca2" acquired by "delete_volume" :: waited 0.025s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:43 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbbfe1f-0e0d-4162-b04b-8fd9571a56d7]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:43 devstack sudo[112852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2 Jun 19 04:35:43 devstack sudo[112852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:44 devstack sudo[112852]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2" returned: 0 in 0.756s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:44 devstack sudo[112857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2 Jun 19 04:35:44 devstack sudo[112857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:45 devstack sudo[112857]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6b8460cd-97be-4e40-a893-0a698cfe2ca2" returned: 0 in 0.630s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-quobyte-6b8460cd-97be-4e40-a893-0a698cfe2ca2" released by "delete_volume" :: held 1.428s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Created reservations ['5ec01caf-1c46-43e3-8bc2-92f58cc2bc4b', 'a9c48bd4-5954-4c72-bc10-2761a3f4a101', '1c0ad4a5-3bec-4518-9501-c96a23a70396', '8b795ce1-54c4-4ebb-ae05-aa542b2a5d29'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:45 devstack sudo[112860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:35:45 devstack sudo[112860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "cinder-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:45 devstack sudo[112860]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.637s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:45 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Deleted volume successfully. Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a74c5668-4af7-4b92-a989-1c2dd86cbbf2 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-6b8460cd-97be-4e40-a893-0a698cfe2ca2-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "cinder-quobyte-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-quobyte-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b" acquired by "delete_volume" :: waited 0.014s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9eacc68-26be-4174-8e7b-284dc5ce70e0]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:46 devstack sudo[112863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b Jun 19 04:35:46 devstack sudo[112863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:46 devstack sudo[112863]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b" returned: 0 in 0.736s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:46 devstack sudo[112868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b Jun 19 04:35:46 devstack sudo[112868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:47 devstack sudo[112868]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b" returned: 0 in 0.662s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:47 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-quobyte-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b" released by "delete_volume" :: held 1.435s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:47 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Created reservations ['e092744e-8cf9-4e3f-bee6-9f9f05554740', '59799636-2a94-4437-be22-236187b90172', '77676329-0ec0-4d17-9e0a-889a041c9855', '2cf92e45-df8f-469a-a471-33d281839497'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:47 devstack sudo[112871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:35:47 devstack sudo[112871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:48 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "cinder-1fde79cc-a80d-4b7c-9871-2af01d142e7b-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:48 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-1fde79cc-a80d-4b7c-9871-2af01d142e7b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:48 devstack sudo[112871]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.645s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:48 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:48 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Deleted volume successfully. Jun 19 04:35:48 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "cinder-quobyte-1fde79cc-a80d-4b7c-9871-2af01d142e7b" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:48 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-2f28f7a1-1d84-4f65-b1a2-c73250f208f4 tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-d8e2ad31-cb92-4c3e-b2d3-00b2df36dd9b-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:48 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-quobyte-1fde79cc-a80d-4b7c-9871-2af01d142e7b" acquired by "delete_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:48 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24d5f4-fa81-4b0a-9337-ee5206194714]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:48 devstack sudo[112908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b Jun 19 04:35:48 devstack sudo[112908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:48 devstack sudo[112908]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b" returned: 0 in 0.748s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:48 devstack sudo[112915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b Jun 19 04:35:48 devstack sudo[112915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:49 devstack sudo[112915]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-1fde79cc-a80d-4b7c-9871-2af01d142e7b" returned: 0 in 0.624s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:49 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-quobyte-1fde79cc-a80d-4b7c-9871-2af01d142e7b" released by "delete_volume" :: held 1.413s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:49 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Created reservations ['584aaf14-9d6f-4866-ab87-6e2a0fe3e7f4', 'cf52f64f-4541-478e-85ef-be730bc14d0f', '2cf2d251-063d-4a37-a045-b67542cc4b50', 'cdde143f-fbf9-4f3c-81c1-9615835ccd53'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:49 devstack sudo[112918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:35:49 devstack sudo[112918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:50 devstack sudo[112918]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.648s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:50 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:50 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Deleted volume successfully. Jun 19 04:35:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-f4151c11-8df0-4031-8b2e-0f2854fa0b2a tempest-CreateVolumesFromSourceVolumeTest-1339740378 None] Lock "cinder-1fde79cc-a80d-4b7c-9871-2af01d142e7b-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:54 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Flow 'volume_create_manager' (eacc9ac2-413d-4a90-85e3-cf32b00bf0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c12259-c002-40c7-addd-3f758f812d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c12259-c002-40c7-addd-3f758f812d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917d6c4b-1c63-485f-aab4-782d268a7c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2260aad7771647cf9886a5eb55927293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:55Z,use_quota=True,user_id='bb8501c16450419e8d8c549dd0624887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c41d231-e034-4c93-b258-56c29a4768a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c41d231-e034-4c93-b258-56c29a4768a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:54 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (babf9696-e209-4442-b295-ed94f7ab4c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:55 devstack cinder-volume[93530]: DEBUG cinder.image.glance [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Creating Keystone auth plugin from conf {{(pid=93530) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:35:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (babf9696-e209-4442-b295-ed94f7ab4c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '917d6c4b-1c63-485f-aab4-782d268a7c32', 'volume_name': 'volume-917d6c4b-1c63-485f-aab4-782d268a7c32', 'volume_size': 1, 'image_id': '79f952dd-c4f1-4b91-a922-91256e880e5b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79f952dd-c4f1-4b91-a922-91256e880e5b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca08b98a4e548ab10c96c55623671afe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2260aad7771647cf9886a5eb55927293', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd36475d739a8126a209215761fd45f7a6c4e1aae41bdfe8bf232cc3ab595f7c0227ba8dcf443493bf75e4970d90d908cad0701c58bb8d5e122af46e42bd732a3', 'id': '79f952dd-c4f1-4b91-a922-91256e880e5b', 'created_at': datetime.datetime(2026, 6, 19, 2, 35, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 35, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79f952dd-c4f1-4b91-a922-91256e880e5b/file', 'properties': {}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdda372-4b08-49b1-8d15-eb16fa128142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efdda372-4b08-49b1-8d15-eb16fa128142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:55 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf4c44d-cb63-49b8-a951-020bc18015dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:55 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Volume 917d6c4b-1c63-485f-aab4-782d268a7c32: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-917d6c4b-1c63-485f-aab4-782d268a7c32', 'volume_size': 1, 'image_id': '79f952dd-c4f1-4b91-a922-91256e880e5b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79f952dd-c4f1-4b91-a922-91256e880e5b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca08b98a4e548ab10c96c55623671afe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2260aad7771647cf9886a5eb55927293', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd36475d739a8126a209215761fd45f7a6c4e1aae41bdfe8bf232cc3ab595f7c0227ba8dcf443493bf75e4970d90d908cad0701c58bb8d5e122af46e42bd732a3', 'id': '79f952dd-c4f1-4b91-a922-91256e880e5b', 'created_at': datetime.datetime(2026, 6, 19, 2, 35, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 35, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79f952dd-c4f1-4b91-a922-91256e880e5b/file', 'properties': {}}, 'image_service': } Jun 19 04:35:55 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Trying to clone 917d6c4b-1c63-485f-aab4-782d268a7c32 from image 79f952dd-c4f1-4b91-a922-91256e880e5b at location (None, [{'url': 'file:///opt/stack/data/glance/images/79f952dd-c4f1-4b91-a922-91256e880e5b', 'metadata': {}}]). {{(pid=93530) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:35:55 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:35:55 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Image download 0.00 MB at 0.00 MB/s Jun 19 04:35:55 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a73ee6e-812d-4299-a290-1765fbc0d305]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:55 devstack sudo[112922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD Jun 19 04:35:55 devstack sudo[112922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:56 devstack sudo[112922]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD" returned: 0 in 0.694s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:56 devstack sudo[112926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD Jun 19 04:35:56 devstack sudo[112926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:56 devstack sudo[112926]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD" returned: 1 in 0.702s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:35:56 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Temporary image 79f952dd-c4f1-4b91-a922-91256e880e5b is fetched for user bb8501c16450419e8d8c549dd0624887. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:35:56 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f5a4b1-aca4-42e1-b7f6-12630bf51221]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:56 devstack sudo[112931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD Jun 19 04:35:56 devstack sudo[112931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:57 devstack sudo[112931]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD" returned: 0 in 0.714s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:57 devstack sudo[112935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD Jun 19 04:35:57 devstack sudo[112935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:58 devstack sudo[112935]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD" returned: 1 in 0.717s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=917d6c4b-1c63-485f-aab4-782d268a7c32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2260aad7771647cf9886a5eb55927293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:55Z,use_quota=True,user_id='bb8501c16450419e8d8c549dd0624887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Creating volume 917d6c4b-1c63-485f-aab4-782d268a7c32 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:58 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:58 devstack sudo[112940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 1073741824 Jun 19 04:35:58 devstack sudo[112940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:58 devstack sudo[112947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:35:58 devstack sudo[112947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:58 devstack sudo[112940]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 1073741824" returned: 0 in 0.761s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:59 devstack sudo[112949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 Jun 19 04:35:59 devstack sudo[112949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:59 devstack sudo[112947]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.677s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:35:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:35:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:35:59 devstack sudo[112949]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32" returned: 0 in 0.628s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:59 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:59 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Attempting download of 79f952dd-c4f1-4b91-a922-91256e880e5b ((None, [{'url': 'file:///opt/stack/data/glance/images/79f952dd-c4f1-4b91-a922-91256e880e5b', 'metadata': {}}])) to volume 917d6c4b-1c63-485f-aab4-782d268a7c32. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:35:59 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[f951e5e8-1d6f-479b-88eb-e20968c2cdec]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79f952dd-c4f1-4b91-a922-91256e880e5b_btc0xxfg {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:59 devstack sudo[112953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79f952dd-c4f1-4b91-a922-91256e880e5b_btc0xxfg Jun 19 04:35:59 devstack sudo[112953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:00 devstack sudo[112953]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_79f952dd-c4f1-4b91-a922-91256e880e5b_btc0xxfg" returned: 0 in 0.688s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79f952dd-c4f1-4b91-a922-91256e880e5b_btc0xxfg {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:00 devstack sudo[112957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79f952dd-c4f1-4b91-a922-91256e880e5b_btc0xxfg Jun 19 04:36:00 devstack sudo[112957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:01 devstack sudo[112957]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79f952dd-c4f1-4b91-a922-91256e880e5b_btc0xxfg" returned: 1 in 0.695s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_79f952dd-c4f1-4b91-a922-91256e880e5b_btc0xxfg' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:01 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db204a8-9105-4eaf-af4a-2eb80680d992]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:01 devstack sudo[112961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD Jun 19 04:36:01 devstack sudo[112961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:01 devstack sudo[112961]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD" returned: 0 in 0.716s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:01 devstack sudo[112966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD Jun 19 04:36:01 devstack sudo[112966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:02 devstack sudo[112966]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD" returned: 1 in 0.685s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:02 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] 79f952dd-c4f1-4b91-a922-91256e880e5b was raw, converting to raw {{(pid=93530) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:36:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:02 devstack sudo[112971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 Jun 19 04:36:02 devstack sudo[112971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:03 devstack sudo[112971]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32" returned: 0 in 0.675s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:03 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_79f952dd-c4f1-4b91-a922-91256e880e5b_m5snbynwdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:36:03 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Converted 0.00 MB image at 0.00 MB/s Jun 19 04:36:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:03 devstack sudo[112976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 1G Jun 19 04:36:03 devstack sudo[112976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:03 devstack sudo[112976]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 1G" returned: 0 in 0.683s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:03 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6151f3-3ba4-48f9-afb4-96726b5bea88]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:04 devstack sudo[112981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 Jun 19 04:36:04 devstack sudo[112981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:04 devstack sudo[112981]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32" returned: 0 in 0.754s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:04 devstack sudo[112985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 Jun 19 04:36:04 devstack sudo[112985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:05 devstack sudo[112985]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32" returned: 1 in 0.753s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:05 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Downloaded image 79f952dd-c4f1-4b91-a922-91256e880e5b ((None, [{'url': 'file:///opt/stack/data/glance/images/79f952dd-c4f1-4b91-a922-91256e880e5b', 'metadata': {}}])) to volume 917d6c4b-1c63-485f-aab4-782d268a7c32 successfully. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:36:05 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Temporary image 79f952dd-c4f1-4b91-a922-91256e880e5b for user bb8501c16450419e8d8c549dd0624887 is deleted. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:36:05 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Marking volume 917d6c4b-1c63-485f-aab4-782d268a7c32 as bootable. {{(pid=93530) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:36:05 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Copying metadata from image 79f952dd-c4f1-4b91-a922-91256e880e5b to 917d6c4b-1c63-485f-aab4-782d268a7c32. {{(pid=93530) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:36:05 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Creating volume glance metadata for volume 917d6c4b-1c63-485f-aab4-782d268a7c32 backed by image 79f952dd-c4f1-4b91-a922-91256e880e5b with: {'image_id': '79f952dd-c4f1-4b91-a922-91256e880e5b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ca08b98a4e548ab10c96c55623671afe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93530) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:36:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf4c44d-cb63-49b8-a951-020bc18015dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-917d6c4b-1c63-485f-aab4-782d268a7c32', 'volume_size': 1, 'image_id': '79f952dd-c4f1-4b91-a922-91256e880e5b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/79f952dd-c4f1-4b91-a922-91256e880e5b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ca08b98a4e548ab10c96c55623671afe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2260aad7771647cf9886a5eb55927293', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd36475d739a8126a209215761fd45f7a6c4e1aae41bdfe8bf232cc3ab595f7c0227ba8dcf443493bf75e4970d90d908cad0701c58bb8d5e122af46e42bd732a3', 'id': '79f952dd-c4f1-4b91-a922-91256e880e5b', 'created_at': datetime.datetime(2026, 6, 19, 2, 35, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 35, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/79f952dd-c4f1-4b91-a922-91256e880e5b/file', 'properties': {}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c83fc7b-985e-46ae-b35c-5384f19d1ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:05 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Volume volume-917d6c4b-1c63-485f-aab4-782d268a7c32 (917d6c4b-1c63-485f-aab4-782d268a7c32): created successfully Jun 19 04:36:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c83fc7b-985e-46ae-b35c-5384f19d1ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Flow 'volume_create_manager' (eacc9ac2-413d-4a90-85e3-cf32b00bf0b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:05 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-cd0ba0b2-2c20-4237-8b9c-516a6956333d tempest-VolumeImageDependencyTests-437552705 None] Created volume successfully. Jun 19 04:36:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Acquiring lock "cinder-917d6c4b-1c63-485f-aab4-782d268a7c32-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Lock "cinder-917d6c4b-1c63-485f-aab4-782d268a7c32-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Acquiring lock "cinder-quobyte-917d6c4b-1c63-485f-aab4-782d268a7c32" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:06 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Lock "cinder-quobyte-917d6c4b-1c63-485f-aab4-782d268a7c32" acquired by "delete_volume" :: waited 0.016s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:06 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[75031192-69d0-483f-bef1-51b523356195]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:06 devstack sudo[112990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 Jun 19 04:36:06 devstack sudo[112990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:07 devstack sudo[112990]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32" returned: 0 in 0.747s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:07 devstack sudo[112996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 Jun 19 04:36:07 devstack sudo[112996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:08 devstack sudo[112996]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32" returned: 1 in 0.723s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:08 devstack sudo[113001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32 Jun 19 04:36:08 devstack sudo[113001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:08 devstack sudo[113001]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-917d6c4b-1c63-485f-aab4-782d268a7c32" returned: 0 in 0.610s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:08 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Lock "cinder-quobyte-917d6c4b-1c63-485f-aab4-782d268a7c32" released by "delete_volume" :: held 2.138s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:08 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Created reservations ['7dd369a5-d560-4fda-8064-c2d684499735', '26d796cc-4a4a-4e11-984c-368633e6aaba', '44f606d2-036c-4978-a3af-267d74136358', 'a1f5e15d-68a0-4c35-b49e-f40c32f03bf0'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:36:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:08 devstack sudo[113004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:08 devstack sudo[113004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:09 devstack sudo[113004]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.632s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:09 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:36:09 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Deleted volume successfully. Jun 19 04:36:09 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d1ba6d30-e496-4f6a-b900-cb554965c463 tempest-VolumeImageDependencyTests-437552705 None] Lock "cinder-917d6c4b-1c63-485f-aab4-782d268a7c32-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:18 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:INSERT=13,cinder:UPDATE=41,cinder:SELECT=37,cinder:DELETE=1 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:36:19 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=21,cinder:INSERT=15,cinder:UPDATE=40,cinder:DELETE=4 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Flow 'volume_create_manager' (d8ced49b-dc88-476a-8037-18e045ef6799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5860911-03f5-4bc2-bc7b-d85c2e31d63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5860911-03f5-4bc2-bc7b-d85c2e31d63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1301851762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873b59fb-a4bc-44be-b348-9e99e5f56e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1163f94f1a4179ba904141fba58f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:22Z,use_quota=True,user_id='baf82586a65e4aa0b8b6a07ffff80338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0290154d-9ab9-4ea4-b40f-cb5d2fabde74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0290154d-9ab9-4ea4-b40f-cb5d2fabde74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3789bb0-785e-4744-b2af-c6cdedbc93be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3789bb0-785e-4744-b2af-c6cdedbc93be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '873b59fb-a4bc-44be-b348-9e99e5f56e90', 'volume_name': 'volume-873b59fb-a4bc-44be-b348-9e99e5f56e90', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122e8814-5af9-401c-afa1-8940fdcecd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122e8814-5af9-401c-afa1-8940fdcecd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae64668c-d5cc-4f06-a217-b50207d8f641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:22 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume 873b59fb-a4bc-44be-b348-9e99e5f56e90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-873b59fb-a4bc-44be-b348-9e99e5f56e90', 'volume_size': 1} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1301851762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873b59fb-a4bc-44be-b348-9e99e5f56e90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1163f94f1a4179ba904141fba58f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:22Z,use_quota=True,user_id='baf82586a65e4aa0b8b6a07ffff80338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Creating volume 873b59fb-a4bc-44be-b348-9e99e5f56e90 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:22 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-873b59fb-a4bc-44be-b348-9e99e5f56e90 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:22 devstack sudo[113049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-873b59fb-a4bc-44be-b348-9e99e5f56e90 1073741824 Jun 19 04:36:22 devstack sudo[113049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Flow 'volume_create_manager' (2ef65804-1962-4abd-ab8a-fa2c126dcf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b67549-65c9-4e26-a38d-7245dbc2644b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b67549-65c9-4e26-a38d-7245dbc2644b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1357566079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c253b6-a15c-451f-a69e-3a1bb26525b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0210c0ab569d432a8daa98787f28734a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:23Z,use_quota=True,user_id='1fdc6e6a4f0d4e9983b29d6b83e7921f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3228b58-b118-4be7-8fe4-0752c48d3520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3228b58-b118-4be7-8fe4-0752c48d3520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b201c875-f282-4419-ac77-98fe03558962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b201c875-f282-4419-ac77-98fe03558962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c253b6-a15c-451f-a69e-3a1bb26525b6', 'volume_name': 'volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5303211a-e85b-4eb4-9193-d0e9ceef57f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5303211a-e85b-4eb4-9193-d0e9ceef57f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a1af07-4053-43da-ac86-4cb46d0eba66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:22 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Volume c0c253b6-a15c-451f-a69e-3a1bb26525b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6', 'volume_size': 1} Jun 19 04:36:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Flow 'volume_create_manager' (8a3303a9-023f-41dd-a05e-571ec0c9451c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f651309e-3f9a-47bd-a995-c06779a11c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f651309e-3f9a-47bd-a995-c06779a11c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2067485829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4c7db3-a72b-4174-af3d-f9cfe41d22cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0210c0ab569d432a8daa98787f28734a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:23Z,use_quota=True,user_id='1fdc6e6a4f0d4e9983b29d6b83e7921f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59840b00-7686-4046-b247-325bb7c7b34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59840b00-7686-4046-b247-325bb7c7b34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0de113-940e-49ec-ae17-c7bb95505091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f0de113-940e-49ec-ae17-c7bb95505091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b4c7db3-a72b-4174-af3d-f9cfe41d22cf', 'volume_name': 'volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad9c233-ce1e-4d18-abcd-be61a45cc86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad9c233-ce1e-4d18-abcd-be61a45cc86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91fdeca9-8d00-43af-8913-d32f60ec8f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:23 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Volume 4b4c7db3-a72b-4174-af3d-f9cfe41d22cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf', 'volume_size': 1} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Flow 'volume_create_manager' (c87aedc9-ec23-42a0-94ee-8e838022c5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967b8db7-8813-4039-bd6d-47be0e993d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (967b8db7-8813-4039-bd6d-47be0e993d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1484334057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1bdca28-6034-44c1-85ab-d76e423c5da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0210c0ab569d432a8daa98787f28734a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:24Z,use_quota=True,user_id='1fdc6e6a4f0d4e9983b29d6b83e7921f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4515c828-0324-44cb-8b1c-5bd08ee49d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4515c828-0324-44cb-8b1c-5bd08ee49d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1a4ca9-9487-427b-9d7c-b1ced0f2970c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1a4ca9-9487-427b-9d7c-b1ced0f2970c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1bdca28-6034-44c1-85ab-d76e423c5da6', 'volume_name': 'volume-c1bdca28-6034-44c1-85ab-d76e423c5da6', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c859fa-8514-4734-bf76-890a15eeaa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c859fa-8514-4734-bf76-890a15eeaa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d5bce3-ad3c-4a20-b0e3-1fa22eb9b7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:23 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Volume c1bdca28-6034-44c1-85ab-d76e423c5da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1bdca28-6034-44c1-85ab-d76e423c5da6', 'volume_size': 1} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:23 devstack sudo[113049]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-873b59fb-a4bc-44be-b348-9e99e5f56e90 1073741824" returned: 0 in 1.513s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-873b59fb-a4bc-44be-b348-9e99e5f56e90 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:23 devstack sudo[113055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-873b59fb-a4bc-44be-b348-9e99e5f56e90 Jun 19 04:36:23 devstack sudo[113055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Flow 'volume_create_manager' (ad17ef4b-8c5c-415d-a25a-d9dc829c13fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054e67fc-afa0-48e7-80b9-dcbf1ac028a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (054e67fc-afa0-48e7-80b9-dcbf1ac028a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-714534584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c888e3a-bc81-41d1-b0b8-0a096ce0dd27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0210c0ab569d432a8daa98787f28734a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:24Z,use_quota=True,user_id='1fdc6e6a4f0d4e9983b29d6b83e7921f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61203524-bb04-449e-85b8-1aa0973db9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61203524-bb04-449e-85b8-1aa0973db9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3920d31f-265b-4b5a-b8c6-630ab22bce39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3920d31f-265b-4b5a-b8c6-630ab22bce39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c888e3a-bc81-41d1-b0b8-0a096ce0dd27', 'volume_name': 'volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9051f532-5944-46c0-a836-081b13cbfba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9051f532-5944-46c0-a836-081b13cbfba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87120858-e33b-4dba-ba45-3fc58291889f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:24 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Volume 6c888e3a-bc81-41d1-b0b8-0a096ce0dd27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27', 'volume_size': 1} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:24 devstack sudo[113055]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-873b59fb-a4bc-44be-b348-9e99e5f56e90" returned: 0 in 0.857s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] <== create_volume: return (2429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.431s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.843s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1357566079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c253b6-a15c-451f-a69e-3a1bb26525b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0210c0ab569d432a8daa98787f28734a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:23Z,use_quota=True,user_id='1fdc6e6a4f0d4e9983b29d6b83e7921f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Creating volume c0c253b6-a15c-451f-a69e-3a1bb26525b6 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:24 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae64668c-d5cc-4f06-a217-b50207d8f641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-873b59fb-a4bc-44be-b348-9e99e5f56e90', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:24 devstack sudo[113064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6 1073741824 Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c76985a-bfae-49f3-9bd1-e3907c1ed9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:24 devstack sudo[113064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:24 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume volume-873b59fb-a4bc-44be-b348-9e99e5f56e90 (873b59fb-a4bc-44be-b348-9e99e5f56e90): created successfully Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c76985a-bfae-49f3-9bd1-e3907c1ed9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Flow 'volume_create_manager' (d8ced49b-dc88-476a-8037-18e045ef6799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:24 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-803ce0a2-6167-4e5a-946b-e301e6abb620 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Created volume successfully. Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Flow 'volume_create_manager' (e6936f3b-0734-4cbe-a80c-fdf3919559ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e591f28-492e-4126-a757-a4cdfd04b6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e591f28-492e-4126-a757-a4cdfd04b6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1941299279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03abc3b-6b8e-4c91-b5a8-cd240fa75d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0210c0ab569d432a8daa98787f28734a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:25Z,use_quota=True,user_id='1fdc6e6a4f0d4e9983b29d6b83e7921f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62049022-11e3-459e-a65c-3cec5934633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62049022-11e3-459e-a65c-3cec5934633f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b218f55-b395-4df2-823c-7a73cce83870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b218f55-b395-4df2-823c-7a73cce83870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c03abc3b-6b8e-4c91-b5a8-cd240fa75d72', 'volume_name': 'volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81a506e-aa77-4272-b8e4-ce1ccb0dbd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81a506e-aa77-4272-b8e4-ce1ccb0dbd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419198f0-a6e6-4ccc-83e8-60f86c85efb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:24 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Volume c03abc3b-6b8e-4c91-b5a8-cd240fa75d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72', 'volume_size': 1} Jun 19 04:36:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:25 devstack sudo[113064]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6 1073741824" returned: 0 in 1.156s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:25 devstack sudo[113069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6 Jun 19 04:36:25 devstack sudo[113069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Flow 'volume_create_manager' (42c8bd46-bf66-404a-802a-12957f5e5f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e62a36d-4be4-4fa4-93cc-66c00357f30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e62a36d-4be4-4fa4-93cc-66c00357f30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d30476-b93a-426c-ae5f-296a6fa060d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a65dfafd114b0c9075186f1ed0fd7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:26Z,use_quota=True,user_id='8729465ba3e045c2b5d2330fe14c07d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40466c4-7fb9-4dae-9a93-ea71bf4c97d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40466c4-7fb9-4dae-9a93-ea71bf4c97d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9ff4f4-fb60-464a-a56d-855647e84e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.image.glance [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Creating Keystone auth plugin from conf {{(pid=93530) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Flow 'volume_create_manager' (31a56c60-4082-4d4b-b99f-379d2a098701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a7015b-e363-43ab-a354-57cf1f20909b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a7015b-e363-43ab-a354-57cf1f20909b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-130746617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba7d8db-8541-4e8b-8b7e-fc7c323034a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1163f94f1a4179ba904141fba58f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:26Z,use_quota=True,user_id='baf82586a65e4aa0b8b6a07ffff80338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8157c2b8-d03b-49c2-b3e1-057cb169c339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8157c2b8-d03b-49c2-b3e1-057cb169c339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec7ec10-90b8-4c32-96ea-a41d368f16ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec7ec10-90b8-4c32-96ea-a41d368f16ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba7d8db-8541-4e8b-8b7e-fc7c323034a8', 'volume_name': 'volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45dd6050-0020-4b23-8bd8-e8f88c1a37b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45dd6050-0020-4b23-8bd8-e8f88c1a37b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee18a3a-b7c7-452c-b69e-48ac525c0c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume 6ba7d8db-8541-4e8b-8b7e-fc7c323034a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8', 'volume_size': 1} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9ff4f4-fb60-464a-a56d-855647e84e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '62d30476-b93a-426c-ae5f-296a6fa060d9', 'volume_name': 'volume-62d30476-b93a-426c-ae5f-296a6fa060d9', 'volume_size': 1, 'image_id': 'edbba5b6-8693-4202-b81e-9eadebfe45a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edbba5b6-8693-4202-b81e-9eadebfe45a9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6c49422e46f7d3b43a58727baefbe146', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3a65dfafd114b0c9075186f1ed0fd7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '650082f9fcf47be2b278e68cff226da6b874bb2ecda74afb875fd5b923017c143e09c73b7542928a1628eb65cdcb312db6a8fc9562158b604775020d3f5bb2f5', 'id': 'edbba5b6-8693-4202-b81e-9eadebfe45a9', 'created_at': datetime.datetime(2026, 6, 19, 2, 36, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 36, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edbba5b6-8693-4202-b81e-9eadebfe45a9/file', 'properties': {}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e4493c-e6e9-4392-9f0d-2447adb3a058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e4493c-e6e9-4392-9f0d-2447adb3a058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7f29f2-c8f4-4d5e-912b-83f684fb3909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Volume 62d30476-b93a-426c-ae5f-296a6fa060d9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-62d30476-b93a-426c-ae5f-296a6fa060d9', 'volume_size': 1, 'image_id': 'edbba5b6-8693-4202-b81e-9eadebfe45a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edbba5b6-8693-4202-b81e-9eadebfe45a9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6c49422e46f7d3b43a58727baefbe146', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3a65dfafd114b0c9075186f1ed0fd7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '650082f9fcf47be2b278e68cff226da6b874bb2ecda74afb875fd5b923017c143e09c73b7542928a1628eb65cdcb312db6a8fc9562158b604775020d3f5bb2f5', 'id': 'edbba5b6-8693-4202-b81e-9eadebfe45a9', 'created_at': datetime.datetime(2026, 6, 19, 2, 36, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 36, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edbba5b6-8693-4202-b81e-9eadebfe45a9/file', 'properties': {}}, 'image_service': } Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Trying to clone 62d30476-b93a-426c-ae5f-296a6fa060d9 from image edbba5b6-8693-4202-b81e-9eadebfe45a9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/edbba5b6-8693-4202-b81e-9eadebfe45a9', 'metadata': {}}]). {{(pid=93530) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Flow 'volume_create_manager' (ea6ac706-3570-46b8-a195-32d76a523fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aabfb2a-f5cc-4533-8fed-028a658beaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aabfb2a-f5cc-4533-8fed-028a658beaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922515312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21976ed7-9359-45ef-9c34-c7d0bae8c4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1163f94f1a4179ba904141fba58f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:27Z,use_quota=True,user_id='baf82586a65e4aa0b8b6a07ffff80338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:26 devstack sudo[113069]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a046f67-fd65-47eb-aec7-e759c3e0ab89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a046f67-fd65-47eb-aec7-e759c3e0ab89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190eb18d-ab8c-4d2b-9b24-618c8cff3871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190eb18d-ab8c-4d2b-9b24-618c8cff3871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21976ed7-9359-45ef-9c34-c7d0bae8c4c9', 'volume_name': 'volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29f86fe-2957-4686-bf21-458ded1ca098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b29f86fe-2957-4686-bf21-458ded1ca098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6554c5-de54-47d5-8ffe-b7da88b1935b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume 21976ed7-9359-45ef-9c34-c7d0bae8c4c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9', 'volume_size': 1} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:36:26 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Image download 0.00 MB at 0.00 MB/s Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6" returned: 0 in 0.969s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.191s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.567s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2067485829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4c7db3-a72b-4174-af3d-f9cfe41d22cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0210c0ab569d432a8daa98787f28734a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:23Z,use_quota=True,user_id='1fdc6e6a4f0d4e9983b29d6b83e7921f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Creating volume 4b4c7db3-a72b-4174-af3d-f9cfe41d22cf {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:26 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a1af07-4053-43da-ac86-4cb46d0eba66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b731aa-195e-4365-8724-57c6ddef46c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:26 devstack sudo[113072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf 1073741824 Jun 19 04:36:26 devstack sudo[113072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:26 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Volume volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6 (c0c253b6-a15c-451f-a69e-3a1bb26525b6): created successfully Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b731aa-195e-4365-8724-57c6ddef46c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Flow 'volume_create_manager' (2ef65804-1962-4abd-ab8a-fa2c126dcf21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[6435e6bf-c2f7-4aaa-ab79-9191992b6ca7]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:27 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-1d4705ab-91e5-4e27-b9ce-449b8d1ef24d tempest-CreateVolumesFromImageTest-1290330071 None] Created volume successfully. Jun 19 04:36:27 devstack sudo[113074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD Jun 19 04:36:27 devstack sudo[113074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Flow 'volume_create_manager' (373c579b-fecf-4ce1-a597-c6fd51719752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38b4597-59f5-4ef5-85dc-3e325c0686b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b38b4597-59f5-4ef5-85dc-3e325c0686b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1570189465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5d1909-a783-40f2-9fa9-f7b4c8de1e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1163f94f1a4179ba904141fba58f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:27Z,use_quota=True,user_id='baf82586a65e4aa0b8b6a07ffff80338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6056bd38-eed1-47be-a326-55cb9eb54203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6056bd38-eed1-47be-a326-55cb9eb54203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f69fc7d-e288-411f-bbbe-280ac713404a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f69fc7d-e288-411f-bbbe-280ac713404a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5d1909-a783-40f2-9fa9-f7b4c8de1e27', 'volume_name': 'volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbff433f-b517-4cc9-b543-1eec3182fe78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbff433f-b517-4cc9-b543-1eec3182fe78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d9dbf9-9d06-4152-95a0-48ea3b7096dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:27 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume 5d5d1909-a783-40f2-9fa9-f7b4c8de1e27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27', 'volume_size': 1} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Flow 'volume_create_manager' (4b40f395-64da-48e4-ad01-79e4eda2d396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5dee09-f4b3-49d8-8546-cf896e3c4e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5dee09-f4b3-49d8-8546-cf896e3c4e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f44e38-10b5-467d-b968-15ceb1227102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01626745c5254ce59764c60be1bd41e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:28Z,use_quota=True,user_id='80ceb552fa194174bfe25d906f373a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7314d34b-1206-4a29-b910-a54663205818),volume_type_id=7314d34b-1206-4a29-b910-a54663205818)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cecd4b0-b51d-46ae-9cf0-2a6a76dc18a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cecd4b0-b51d-46ae-9cf0-2a6a76dc18a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9867ee4-f94a-4915-990b-9d7a3e11d130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.image.glance [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Creating Keystone auth plugin from conf {{(pid=93530) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9867ee4-f94a-4915-990b-9d7a3e11d130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '86f44e38-10b5-467d-b968-15ceb1227102', 'volume_name': 'volume-86f44e38-10b5-467d-b968-15ceb1227102', 'volume_size': 1, 'image_id': 'bdca5202-b14e-43d8-adf9-655d4fefc02b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdca5202-b14e-43d8-adf9-655d4fefc02b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c00b2183b37e2a54ae762d17131e280', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01626745c5254ce59764c60be1bd41e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf5b4ad3d72256a93addd4324b384f004c04be90e34b1723be6232fb1646d98a62c2b5a31596b6c2ff4db441c5bc33e3aa41505fbe33ce9b23ae0f620c063599', 'id': 'bdca5202-b14e-43d8-adf9-655d4fefc02b', 'created_at': datetime.datetime(2026, 6, 19, 2, 36, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 36, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdca5202-b14e-43d8-adf9-655d4fefc02b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25109508-35d5-480c-93c9-c3ffc2d5fb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25109508-35d5-480c-93c9-c3ffc2d5fb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6902f59-efeb-46e9-b65e-08e287d3b0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:27 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Volume 86f44e38-10b5-467d-b968-15ceb1227102: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-86f44e38-10b5-467d-b968-15ceb1227102', 'volume_size': 1, 'image_id': 'bdca5202-b14e-43d8-adf9-655d4fefc02b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdca5202-b14e-43d8-adf9-655d4fefc02b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c00b2183b37e2a54ae762d17131e280', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01626745c5254ce59764c60be1bd41e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf5b4ad3d72256a93addd4324b384f004c04be90e34b1723be6232fb1646d98a62c2b5a31596b6c2ff4db441c5bc33e3aa41505fbe33ce9b23ae0f620c063599', 'id': 'bdca5202-b14e-43d8-adf9-655d4fefc02b', 'created_at': datetime.datetime(2026, 6, 19, 2, 36, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 36, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdca5202-b14e-43d8-adf9-655d4fefc02b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 19 04:36:27 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Trying to clone 86f44e38-10b5-467d-b968-15ceb1227102 from image bdca5202-b14e-43d8-adf9-655d4fefc02b at location (None, [{'url': 'file:///opt/stack/data/glance/images/bdca5202-b14e-43d8-adf9-655d4fefc02b', 'metadata': {}}]). {{(pid=93530) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:36:28 devstack sudo[113072]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf 1073741824" returned: 0 in 1.124s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Flow 'volume_create_manager' (842cbce4-9967-4b2d-8a7a-479ca6523c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:28 devstack sudo[113074]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (511c042f-c824-41cc-a544-1e12f0c45911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:36:28 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Image download 0.00 MB at 0.00 MB/s Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD" returned: 0 in 1.182s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (511c042f-c824-41cc-a544-1e12f0c45911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-414123648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aefbd3fa-5a9c-422b-9be7-73118d8147b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1163f94f1a4179ba904141fba58f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:28Z,use_quota=True,user_id='baf82586a65e4aa0b8b6a07ffff80338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab456cd8-301e-4847-a272-ad59c2cb8cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab456cd8-301e-4847-a272-ad59c2cb8cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b497a1-b276-4664-b9a8-39ba6a922ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b497a1-b276-4664-b9a8-39ba6a922ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aefbd3fa-5a9c-422b-9be7-73118d8147b8', 'volume_name': 'volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0f3277-307e-4ffc-9ea5-a18bc6fc2d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0f3277-307e-4ffc-9ea5-a18bc6fc2d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a889342-c488-42b1-b62f-b1fafa341692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:28 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume aefbd3fa-5a9c-422b-9be7-73118d8147b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8', 'volume_size': 1} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:28 devstack sudo[113082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf Jun 19 04:36:28 devstack sudo[113082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:28 devstack sudo[113081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD Jun 19 04:36:28 devstack sudo[113081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54962ee-11a0-471b-b176-155145fe5089]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:28 devstack sudo[113085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD Jun 19 04:36:28 devstack sudo[113085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Flow 'volume_create_manager' (fccb9783-5cc3-4f0d-8c1e-3b6660afc5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f940d46a-f0c1-4b61-b4e0-62020b622829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f940d46a-f0c1-4b61-b4e0-62020b622829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-468902377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7c435a-ca22-477e-89d0-30f39e5d501b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1163f94f1a4179ba904141fba58f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:29Z,use_quota=True,user_id='baf82586a65e4aa0b8b6a07ffff80338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3a506a-07ba-41d2-aab1-20acb729409c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3a506a-07ba-41d2-aab1-20acb729409c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aba7cd7-51e0-47c8-9dc6-0cfebab0149b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aba7cd7-51e0-47c8-9dc6-0cfebab0149b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b7c435a-ca22-477e-89d0-30f39e5d501b', 'volume_name': 'volume-5b7c435a-ca22-477e-89d0-30f39e5d501b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02aa4a9-753b-4402-b883-87d8a3f67894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02aa4a9-753b-4402-b883-87d8a3f67894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb06b91-98b5-4159-aeb0-850dd6a71a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:28 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume 5b7c435a-ca22-477e-89d0-30f39e5d501b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b7c435a-ca22-477e-89d0-30f39e5d501b', 'volume_size': 1} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:28 devstack sudo[113082]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf" returned: 0 in 0.688s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] <== create_volume: return (2056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.211s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1484334057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1bdca28-6034-44c1-85ab-d76e423c5da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0210c0ab569d432a8daa98787f28734a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:24Z,use_quota=True,user_id='1fdc6e6a4f0d4e9983b29d6b83e7921f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Creating volume c1bdca28-6034-44c1-85ab-d76e423c5da6 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:28 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c1bdca28-6034-44c1-85ab-d76e423c5da6 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:29 devstack sudo[113091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c1bdca28-6034-44c1-85ab-d76e423c5da6 1073741824 Jun 19 04:36:29 devstack sudo[113091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91fdeca9-8d00-43af-8913-d32f60ec8f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcde517d-ed95-4a80-ac98-9cfc3f3abdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:29 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Volume volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf (4b4c7db3-a72b-4174-af3d-f9cfe41d22cf): created successfully Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcde517d-ed95-4a80-ac98-9cfc3f3abdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Flow 'volume_create_manager' (8a3303a9-023f-41dd-a05e-571ec0c9451c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:29 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-dfb4a253-9222-40c7-8c10-7786064ef48b tempest-CreateVolumesFromImageTest-1290330071 None] Created volume successfully. Jun 19 04:36:29 devstack sudo[113081]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD" returned: 1 in 0.897s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Temporary image edbba5b6-8693-4202-b81e-9eadebfe45a9 is fetched for user 8729465ba3e045c2b5d2330fe14c07d8. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8686a6-8239-4c17-ae5b-f0cf5585d8a6]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:29 devstack sudo[113085]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD" returned: 0 in 0.917s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:29 devstack sudo[113095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD Jun 19 04:36:29 devstack sudo[113095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:29 devstack sudo[113096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD Jun 19 04:36:29 devstack sudo[113096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:29 devstack sudo[113091]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c1bdca28-6034-44c1-85ab-d76e423c5da6 1073741824" returned: 0 in 0.886s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c1bdca28-6034-44c1-85ab-d76e423c5da6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:29 devstack sudo[113108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c1bdca28-6034-44c1-85ab-d76e423c5da6 Jun 19 04:36:29 devstack sudo[113108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:29 devstack sudo[113096]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD" returned: 1 in 0.737s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:29 devstack sudo[113095]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Temporary image bdca5202-b14e-43d8-adf9-655d4fefc02b is fetched for user 80ceb552fa194174bfe25d906f373a53. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD" returned: 0 in 0.842s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[8494a0f8-a9c0-4160-a37f-05f0d9b2930b]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:30 devstack sudo[113110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD Jun 19 04:36:30 devstack sudo[113110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:30 devstack sudo[113111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD Jun 19 04:36:30 devstack sudo[113111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:30 devstack sudo[113108]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c1bdca28-6034-44c1-85ab-d76e423c5da6" returned: 0 in 0.651s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.247s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-714534584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c888e3a-bc81-41d1-b0b8-0a096ce0dd27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0210c0ab569d432a8daa98787f28734a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:24Z,use_quota=True,user_id='1fdc6e6a4f0d4e9983b29d6b83e7921f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Creating volume 6c888e3a-bc81-41d1-b0b8-0a096ce0dd27 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:30 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:30 devstack sudo[113115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27 1073741824 Jun 19 04:36:30 devstack sudo[113115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d5bce3-ad3c-4a20-b0e3-1fa22eb9b7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1bdca28-6034-44c1-85ab-d76e423c5da6', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448154f3-7459-4427-ab0c-942a2f061832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:30 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Volume volume-c1bdca28-6034-44c1-85ab-d76e423c5da6 (c1bdca28-6034-44c1-85ab-d76e423c5da6): created successfully Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448154f3-7459-4427-ab0c-942a2f061832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Flow 'volume_create_manager' (c87aedc9-ec23-42a0-94ee-8e838022c5ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:30 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-fe02a0c6-dad6-49f7-9d50-b3de9c099af0 tempest-CreateVolumesFromImageTest-1290330071 None] Created volume successfully. Jun 19 04:36:30 devstack sudo[113110]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD" returned: 1 in 0.782s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:30 devstack sudo[113111]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD" returned: 0 in 0.790s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:30 devstack sudo[113122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD Jun 19 04:36:30 devstack sudo[113122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:31 devstack sudo[113115]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27 1073741824" returned: 0 in 0.842s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:31 devstack sudo[113128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27 Jun 19 04:36:31 devstack sudo[113128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:31 devstack sudo[113122]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD" returned: 1 in 0.768s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:32 devstack sudo[113128]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27" returned: 0 in 0.630s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.145s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1941299279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03abc3b-6b8e-4c91-b5a8-cd240fa75d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0210c0ab569d432a8daa98787f28734a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:25Z,use_quota=True,user_id='1fdc6e6a4f0d4e9983b29d6b83e7921f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Creating volume c03abc3b-6b8e-4c91-b5a8-cd240fa75d72 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:32 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87120858-e33b-4dba-ba45-3fc58291889f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:32 devstack sudo[113134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72 1073741824 Jun 19 04:36:32 devstack sudo[113134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a56662-a9d3-4023-bd76-21d0d8f96458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:32 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Volume volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27 (6c888e3a-bc81-41d1-b0b8-0a096ce0dd27): created successfully Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a56662-a9d3-4023-bd76-21d0d8f96458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Flow 'volume_create_manager' (ad17ef4b-8c5c-415d-a25a-d9dc829c13fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:32 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-3771b0fa-4bd9-4e80-95b9-c5627d35b425 tempest-CreateVolumesFromImageTest-1290330071 None] Created volume successfully. Jun 19 04:36:32 devstack sudo[113134]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72 1073741824" returned: 0 in 0.851s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:33 devstack sudo[113140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72 Jun 19 04:36:33 devstack sudo[113140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:33 devstack sudo[113140]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72" returned: 0 in 0.636s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.151s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-130746617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ba7d8db-8541-4e8b-8b7e-fc7c323034a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1163f94f1a4179ba904141fba58f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:26Z,use_quota=True,user_id='baf82586a65e4aa0b8b6a07ffff80338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Creating volume 6ba7d8db-8541-4e8b-8b7e-fc7c323034a8 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:33 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:33 devstack sudo[113143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8 1073741824 Jun 19 04:36:33 devstack sudo[113143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419198f0-a6e6-4ccc-83e8-60f86c85efb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1b40c5-abe3-44ae-bcec-d63756fee867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:33 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Volume volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72 (c03abc3b-6b8e-4c91-b5a8-cd240fa75d72): created successfully Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e1b40c5-abe3-44ae-bcec-d63756fee867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Flow 'volume_create_manager' (e6936f3b-0734-4cbe-a80c-fdf3919559ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:33 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-6d089cfc-5294-4c54-8093-1a8be60b7f67 tempest-CreateVolumesFromImageTest-1290330071 None] Created volume successfully. Jun 19 04:36:33 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "cinder-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:34 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:34 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "cinder-quobyte-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:34 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-quobyte-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72" acquired by "delete_volume" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:34 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf18128-9f74-43c8-92a2-3c4b3f5cffed]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:34 devstack sudo[113145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72 Jun 19 04:36:34 devstack sudo[113145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:34 devstack sudo[113143]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8 1073741824" returned: 0 in 0.827s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:34 devstack sudo[113150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8 Jun 19 04:36:34 devstack sudo[113150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:34 devstack sudo[113145]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72" returned: 0 in 0.763s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:34 devstack sudo[113155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72 Jun 19 04:36:34 devstack sudo[113155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:35 devstack sudo[113150]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8" returned: 0 in 0.691s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.297s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922515312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21976ed7-9359-45ef-9c34-c7d0bae8c4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1163f94f1a4179ba904141fba58f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:27Z,use_quota=True,user_id='baf82586a65e4aa0b8b6a07ffff80338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Creating volume 21976ed7-9359-45ef-9c34-c7d0bae8c4c9 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:35 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:35 devstack sudo[113158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9 1073741824 Jun 19 04:36:35 devstack sudo[113158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fee18a3a-b7c7-452c-b69e-48ac525c0c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc0fe63-4492-4e3b-af06-2c9e8e8f2538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:35 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8 (6ba7d8db-8541-4e8b-8b7e-fc7c323034a8): created successfully Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc0fe63-4492-4e3b-af06-2c9e8e8f2538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Flow 'volume_create_manager' (31a56c60-4082-4d4b-b99f-379d2a098701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:35 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e263cdd9-29a1-4287-9df8-418628773488 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Created volume successfully. Jun 19 04:36:35 devstack sudo[113155]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72" returned: 0 in 0.631s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-quobyte-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72" released by "delete_volume" :: held 1.442s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Created reservations ['a4329965-233d-4efe-a6df-ca88e6833053', '09406d74-f375-4731-8a6f-abc614c4b8a7', '2ace3490-7895-4860-b19e-dd30b9495ca3', '237aae41-48d0-4579-b36a-8f323d9a8428'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:35 devstack sudo[113161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:35 devstack sudo[113161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:36 devstack sudo[113158]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9 1073741824" returned: 0 in 0.891s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:36 devstack sudo[113167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9 Jun 19 04:36:36 devstack sudo[113167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "cinder-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "cinder-quobyte-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-quobyte-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27" acquired by "delete_volume" :: waited 0.015s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[2003f247-b3d2-4bc0-8015-f124fa73e94c]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:36 devstack sudo[113161]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.778s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:36:36 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Deleted volume successfully. Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-626cb10d-da11-4156-8742-5429383f4b1b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-c03abc3b-6b8e-4c91-b5a8-cd240fa75d72-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:36 devstack sudo[113170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27 Jun 19 04:36:36 devstack sudo[113170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:36 devstack sudo[113167]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9" returned: 0 in 0.681s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.339s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1570189465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5d1909-a783-40f2-9fa9-f7b4c8de1e27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1163f94f1a4179ba904141fba58f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:27Z,use_quota=True,user_id='baf82586a65e4aa0b8b6a07ffff80338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Creating volume 5d5d1909-a783-40f2-9fa9-f7b4c8de1e27 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:36 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:36 devstack sudo[113173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27 1073741824 Jun 19 04:36:36 devstack sudo[113173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6554c5-de54-47d5-8ffe-b7da88b1935b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6e21e2-b9a2-476a-aec6-5c53ca91bdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:36 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9 (21976ed7-9359-45ef-9c34-c7d0bae8c4c9): created successfully Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6e21e2-b9a2-476a-aec6-5c53ca91bdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Flow 'volume_create_manager' (ea6ac706-3570-46b8-a195-32d76a523fc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:36 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d00f4f2a-a98e-4860-807b-1a880d2b41f7 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Created volume successfully. Jun 19 04:36:37 devstack sudo[113170]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27" returned: 0 in 0.811s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:37 devstack sudo[113178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27 Jun 19 04:36:37 devstack sudo[113178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:37 devstack sudo[113173]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27 1073741824" returned: 0 in 0.865s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:37 devstack sudo[113184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27 Jun 19 04:36:37 devstack sudo[113184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:37 devstack sudo[113178]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27" returned: 0 in 0.689s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:37 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-quobyte-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27" released by "delete_volume" :: held 1.552s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:37 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Created reservations ['8013173a-d529-4a70-999f-28f501dafb26', '0f16ed1e-f6ac-4f1f-805d-a96873fed75e', '1c299706-f1f8-407f-ba0e-322d57fb03a4', 'c8ffafe9-df35-480a-8e5d-e50ebd4e29e1'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:38 devstack sudo[113186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:38 devstack sudo[113186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:38 devstack sudo[113184]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27" returned: 0 in 0.670s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.144s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-414123648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aefbd3fa-5a9c-422b-9be7-73118d8147b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1163f94f1a4179ba904141fba58f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:28Z,use_quota=True,user_id='baf82586a65e4aa0b8b6a07ffff80338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Creating volume aefbd3fa-5a9c-422b-9be7-73118d8147b8 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:38 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:38 devstack sudo[113189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8 1073741824 Jun 19 04:36:38 devstack sudo[113189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d9dbf9-9d06-4152-95a0-48ea3b7096dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f551c7-df57-4b7e-89f6-8faced0aa29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "cinder-c1bdca28-6034-44c1-85ab-d76e423c5da6-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:38 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27 (5d5d1909-a783-40f2-9fa9-f7b4c8de1e27): created successfully Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36f551c7-df57-4b7e-89f6-8faced0aa29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Flow 'volume_create_manager' (373c579b-fecf-4ce1-a597-c6fd51719752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:38 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a9eae137-c74f-4069-abe6-87bfc2048972 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Created volume successfully. Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-c1bdca28-6034-44c1-85ab-d76e423c5da6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "cinder-quobyte-c1bdca28-6034-44c1-85ab-d76e423c5da6" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-quobyte-c1bdca28-6034-44c1-85ab-d76e423c5da6" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f68bc66-e77a-40b7-ba3b-f81408b95bb7]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c1bdca28-6034-44c1-85ab-d76e423c5da6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:38 devstack sudo[113192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c1bdca28-6034-44c1-85ab-d76e423c5da6 Jun 19 04:36:38 devstack sudo[113192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:38 devstack sudo[113186]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.723s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:36:38 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Deleted volume successfully. Jun 19 04:36:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-7344fa74-bbcd-43ac-a29b-66d7ed8c430b tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-6c888e3a-bc81-41d1-b0b8-0a096ce0dd27-delete_volume" released by "delete_volume" :: held 2.532s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:39 devstack sudo[113189]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8 1073741824" returned: 0 in 0.951s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:39 devstack sudo[113201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8 Jun 19 04:36:39 devstack sudo[113201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:39 devstack sudo[113192]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c1bdca28-6034-44c1-85ab-d76e423c5da6" returned: 0 in 0.819s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c1bdca28-6034-44c1-85ab-d76e423c5da6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:39 devstack sudo[113203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c1bdca28-6034-44c1-85ab-d76e423c5da6 Jun 19 04:36:39 devstack sudo[113203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:40 devstack sudo[113201]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8" returned: 0 in 0.634s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.297s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-468902377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7c435a-ca22-477e-89d0-30f39e5d501b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1163f94f1a4179ba904141fba58f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:29Z,use_quota=True,user_id='baf82586a65e4aa0b8b6a07ffff80338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Creating volume 5b7c435a-ca22-477e-89d0-30f39e5d501b {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:40 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5b7c435a-ca22-477e-89d0-30f39e5d501b 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a889342-c488-42b1-b62f-b1fafa341692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:40 devstack sudo[113207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5b7c435a-ca22-477e-89d0-30f39e5d501b 1073741824 Jun 19 04:36:40 devstack sudo[113207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d613c4f7-abc6-4d98-86bf-d8018c66ca9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:40 devstack sudo[113203]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:40 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8 (aefbd3fa-5a9c-422b-9be7-73118d8147b8): created successfully Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d613c4f7-abc6-4d98-86bf-d8018c66ca9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Flow 'volume_create_manager' (842cbce4-9967-4b2d-8a7a-479ca6523c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c1bdca28-6034-44c1-85ab-d76e423c5da6" returned: 0 in 0.674s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:40 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-892ab839-32f4-4257-8f7a-478a599d7ce3 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Created volume successfully. Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-quobyte-c1bdca28-6034-44c1-85ab-d76e423c5da6" released by "delete_volume" :: held 1.547s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Created reservations ['9255a387-8f2e-45f8-985d-9ea34fcacc38', '3f9844fa-2727-48d2-815d-8c99725789dc', 'd4c1886c-1c99-4a3a-8066-5807e295fb70', '3adb9e76-d221-465e-b59e-5c06dff2ea2b'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:40 devstack sudo[113209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:40 devstack sudo[113209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "cinder-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "cinder-quobyte-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-quobyte-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c84a05-c7a4-4485-b99a-5e21d74cca97]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:40 devstack sudo[113209]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.640s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:36:40 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Deleted volume successfully. Jun 19 04:36:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-25893ddb-6f7c-4b3a-9c9e-21c610a53fb0 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-c1bdca28-6034-44c1-85ab-d76e423c5da6-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:40 devstack sudo[113216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf Jun 19 04:36:41 devstack sudo[113216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:41 devstack sudo[113207]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5b7c435a-ca22-477e-89d0-30f39e5d501b 1073741824" returned: 0 in 0.948s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5b7c435a-ca22-477e-89d0-30f39e5d501b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:41 devstack sudo[113218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5b7c435a-ca22-477e-89d0-30f39e5d501b Jun 19 04:36:41 devstack sudo[113218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:41 devstack sudo[113218]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5b7c435a-ca22-477e-89d0-30f39e5d501b" returned: 0 in 0.619s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.893s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62d30476-b93a-426c-ae5f-296a6fa060d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3a65dfafd114b0c9075186f1ed0fd7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:26Z,use_quota=True,user_id='8729465ba3e045c2b5d2330fe14c07d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Creating volume 62d30476-b93a-426c-ae5f-296a6fa060d9 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:41 devstack sudo[113216]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:41 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf" returned: 0 in 0.823s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:41 devstack sudo[113225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 1073741824 Jun 19 04:36:41 devstack sudo[113225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb06b91-98b5-4159-aeb0-850dd6a71a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b7c435a-ca22-477e-89d0-30f39e5d501b', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8c3839-337e-48b9-a1a0-69f08c2026bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:41 devstack sudo[113227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf Jun 19 04:36:41 devstack sudo[113227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:41 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Volume volume-5b7c435a-ca22-477e-89d0-30f39e5d501b (5b7c435a-ca22-477e-89d0-30f39e5d501b): created successfully Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8c3839-337e-48b9-a1a0-69f08c2026bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:41 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Flow 'volume_create_manager' (fccb9783-5cc3-4f0d-8c1e-3b6660afc5cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:41 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-3b1bc0c5-a487-4bf8-b146-0cbe4cb6cc5a tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Created volume successfully. Jun 19 04:36:42 devstack sudo[113227]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf" returned: 0 in 0.680s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-quobyte-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf" released by "delete_volume" :: held 1.541s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Created reservations ['262d1903-3e80-4cf9-b01f-7f70184c3c0a', '5bd3aa7f-5c6e-446f-a411-8ca317edb7c7', '36c82702-1286-4d11-910d-37c5b02c8928', 'f9a53e05-37aa-4383-8ebd-6fdb948e105e'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:42 devstack sudo[113225]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 1073741824" returned: 0 in 0.861s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:42 devstack sudo[113233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:42 devstack sudo[113233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "cinder-5b7c435a-ca22-477e-89d0-30f39e5d501b-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-5b7c435a-ca22-477e-89d0-30f39e5d501b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:42 devstack sudo[113235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "cinder-quobyte-5b7c435a-ca22-477e-89d0-30f39e5d501b" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:42 devstack sudo[113235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-quobyte-5b7c435a-ca22-477e-89d0-30f39e5d501b" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffa199e-d63c-4ce3-a737-4dd790c83b22]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5b7c435a-ca22-477e-89d0-30f39e5d501b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:42 devstack sudo[113237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5b7c435a-ca22-477e-89d0-30f39e5d501b Jun 19 04:36:42 devstack sudo[113237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "cinder-c0c253b6-a15c-451f-a69e-3a1bb26525b6-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-c0c253b6-a15c-451f-a69e-3a1bb26525b6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "cinder-quobyte-c0c253b6-a15c-451f-a69e-3a1bb26525b6" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-quobyte-c0c253b6-a15c-451f-a69e-3a1bb26525b6" acquired by "delete_volume" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c733966d-ef49-4d23-a327-ea5a38d75df8]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:43 devstack sudo[113233]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.706s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:36:43 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Deleted volume successfully. Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3784feee-dbcf-47cd-b1ef-2cc6205d0960 tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-4b4c7db3-a72b-4174-af3d-f9cfe41d22cf-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:43 devstack sudo[113240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6 Jun 19 04:36:43 devstack sudo[113240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:43 devstack sudo[113235]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9" returned: 0 in 0.756s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.743s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f44e38-10b5-467d-b968-15ceb1227102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01626745c5254ce59764c60be1bd41e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:28Z,use_quota=True,user_id='80ceb552fa194174bfe25d906f373a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7314d34b-1206-4a29-b910-a54663205818),volume_type_id=7314d34b-1206-4a29-b910-a54663205818)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Creating volume 86f44e38-10b5-467d-b968-15ceb1227102 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:43 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:43 devstack sudo[113243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 1073741824 Jun 19 04:36:43 devstack sudo[113243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Attempting download of edbba5b6-8693-4202-b81e-9eadebfe45a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/edbba5b6-8693-4202-b81e-9eadebfe45a9', 'metadata': {}}])) to volume 62d30476-b93a-426c-ae5f-296a6fa060d9. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[c929e5c9-c31e-4eec-811a-dbdfd57dee73]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edbba5b6-8693-4202-b81e-9eadebfe45a9_8lw7ulb2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:43 devstack sudo[113237]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5b7c435a-ca22-477e-89d0-30f39e5d501b" returned: 0 in 0.890s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5b7c435a-ca22-477e-89d0-30f39e5d501b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:43 devstack sudo[113250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5b7c435a-ca22-477e-89d0-30f39e5d501b Jun 19 04:36:43 devstack sudo[113250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:43 devstack sudo[113249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edbba5b6-8693-4202-b81e-9eadebfe45a9_8lw7ulb2 Jun 19 04:36:43 devstack sudo[113249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:44 devstack sudo[113240]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6" returned: 0 in 0.938s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:44 devstack sudo[113260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6 Jun 19 04:36:44 devstack sudo[113260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:44 devstack sudo[113243]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 1073741824" returned: 0 in 0.850s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:44 devstack sudo[113265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 Jun 19 04:36:44 devstack sudo[113265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:44 devstack sudo[113250]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5b7c435a-ca22-477e-89d0-30f39e5d501b" returned: 0 in 0.774s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-quobyte-5b7c435a-ca22-477e-89d0-30f39e5d501b" released by "delete_volume" :: held 1.722s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:44 devstack sudo[113249]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edbba5b6-8693-4202-b81e-9eadebfe45a9_8lw7ulb2" returned: 0 in 0.902s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edbba5b6-8693-4202-b81e-9eadebfe45a9_8lw7ulb2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Created reservations ['e070a74b-f8fe-4624-8aac-a6436721fe54', 'e1e5b193-2a61-46d7-af86-a581b6edd9d0', 'bd68ed13-984b-4611-88a1-7a46f7c984ad', 'ecd13db0-05a6-4810-b26f-69dee0cef6c0'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:44 devstack sudo[113267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edbba5b6-8693-4202-b81e-9eadebfe45a9_8lw7ulb2 Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:44 devstack sudo[113267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:44 devstack sudo[113269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:44 devstack sudo[113269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "cinder-aefbd3fa-5a9c-422b-9be7-73118d8147b8-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-aefbd3fa-5a9c-422b-9be7-73118d8147b8-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:44 devstack sudo[113260]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-c0c253b6-a15c-451f-a69e-3a1bb26525b6" returned: 0 in 0.792s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-quobyte-c0c253b6-a15c-451f-a69e-3a1bb26525b6" released by "delete_volume" :: held 1.803s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "cinder-quobyte-aefbd3fa-5a9c-422b-9be7-73118d8147b8" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-quobyte-aefbd3fa-5a9c-422b-9be7-73118d8147b8" acquired by "delete_volume" :: waited 0.033s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[54731633-9ff1-4cbe-9767-7e4ad3929d29]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Created reservations ['301bf076-0b9b-4817-9659-70f1182165f6', '5e71afd8-ac3d-4f65-a21f-ddd745f956c7', 'd3de62e5-403b-4748-9174-9d0585f9fcff', '75cc8a37-8c3f-4862-970a-c9568d993d23'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:36:45 devstack sudo[113273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8 Jun 19 04:36:45 devstack sudo[113273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:45 devstack sudo[113265]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102" returned: 0 in 0.976s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:45 devstack sudo[113277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:45 devstack sudo[113277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Attempting download of bdca5202-b14e-43d8-adf9-655d4fefc02b ((None, [{'url': 'file:///opt/stack/data/glance/images/bdca5202-b14e-43d8-adf9-655d4fefc02b', 'metadata': {}}])) to volume 86f44e38-10b5-467d-b968-15ceb1227102. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:36:45 devstack sudo[113267]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edbba5b6-8693-4202-b81e-9eadebfe45a9_8lw7ulb2" returned: 1 in 0.945s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edbba5b6-8693-4202-b81e-9eadebfe45a9_8lw7ulb2' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6af549-37a6-4b0e-8e0f-deee8979ea78]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:45 devstack sudo[113269]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.884s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad909f9-8042-4ce4-963b-31a694f03b9c]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdca5202-b14e-43d8-adf9-655d4fefc02b_vh8x7jwm {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:45 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Deleted volume successfully. Jun 19 04:36:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-94688eed-70b0-4885-a3bf-e14f2fe1f346 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-5b7c435a-ca22-477e-89d0-30f39e5d501b-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:45 devstack sudo[113281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdca5202-b14e-43d8-adf9-655d4fefc02b_vh8x7jwm Jun 19 04:36:45 devstack sudo[113281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:45 devstack sudo[113280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD Jun 19 04:36:45 devstack sudo[113280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:46 devstack sudo[113273]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8" returned: 0 in 1.114s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:46 devstack sudo[113277]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.957s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:46 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:36:46 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Deleted volume successfully. Jun 19 04:36:46 devstack sudo[113288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8 Jun 19 04:36:46 devstack sudo[113288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0964e182-01b8-4654-8a63-863492118fbe tempest-CreateVolumesFromImageTest-1290330071 None] Lock "cinder-c0c253b6-a15c-451f-a69e-3a1bb26525b6-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:46 devstack sudo[113281]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bdca5202-b14e-43d8-adf9-655d4fefc02b_vh8x7jwm" returned: 0 in 1.022s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdca5202-b14e-43d8-adf9-655d4fefc02b_vh8x7jwm {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:46 devstack sudo[113280]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD" returned: 0 in 1.118s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:46 devstack sudo[113294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdca5202-b14e-43d8-adf9-655d4fefc02b_vh8x7jwm Jun 19 04:36:46 devstack sudo[113294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:46 devstack sudo[113295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD Jun 19 04:36:46 devstack sudo[113295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:46 devstack sudo[113288]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-aefbd3fa-5a9c-422b-9be7-73118d8147b8" returned: 0 in 0.823s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-quobyte-aefbd3fa-5a9c-422b-9be7-73118d8147b8" released by "delete_volume" :: held 2.000s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Created reservations ['aa0c204a-63e0-41ba-b390-5b0a0c5c9e03', 'cfc77d31-cf4d-40ac-9aff-40ec9053d532', '5c7d8453-4998-4a88-95b6-5fb76fd22517', '88eaedd1-f02a-4303-ae8e-8e997af7cae0'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:47 devstack sudo[113299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:47 devstack sudo[113299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "cinder-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "cinder-quobyte-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-quobyte-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:47 devstack sudo[113295]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD" returned: 1 in 0.963s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] edbba5b6-8693-4202-b81e-9eadebfe45a9 was raw, converting to raw {{(pid=93530) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[032dfb83-c9bd-4b5f-bf9b-10e695ecaab8]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:47 devstack sudo[113306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 Jun 19 04:36:47 devstack sudo[113306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:47 devstack sudo[113294]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdca5202-b14e-43d8-adf9-655d4fefc02b_vh8x7jwm" returned: 1 in 1.126s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bdca5202-b14e-43d8-adf9-655d4fefc02b_vh8x7jwm' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[8182d69f-91bf-4a0f-aad9-170bd64a8e24]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:47 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:47 devstack sudo[113309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27 Jun 19 04:36:47 devstack sudo[113309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:47 devstack sudo[113310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD Jun 19 04:36:47 devstack sudo[113310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:48 devstack sudo[113299]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.968s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:48 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:36:48 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Deleted volume successfully. Jun 19 04:36:48 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-b5c72adb-45cf-4bae-8d4a-84cf1e185e89 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-aefbd3fa-5a9c-422b-9be7-73118d8147b8-delete_volume" released by "delete_volume" :: held 3.267s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:48 devstack sudo[113306]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9" returned: 0 in 1.143s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:48 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_edbba5b6-8693-4202-b81e-9eadebfe45a9_3c4q5tmndevstack@QuobyteHD, size 0.00 MB, duration 1.14 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:36:48 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Converted 0.00 MB image at 0.00 MB/s Jun 19 04:36:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:48 devstack sudo[113309]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27" returned: 0 in 1.130s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:48 devstack sudo[113357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27 Jun 19 04:36:48 devstack sudo[113356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 1G Jun 19 04:36:48 devstack sudo[113356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:48 devstack sudo[113357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:48 devstack sudo[113310]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD" returned: 0 in 1.119s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:48 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:48 devstack sudo[113360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD Jun 19 04:36:48 devstack sudo[113360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:49 devstack sudo[113357]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27" returned: 0 in 0.790s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-quobyte-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27" released by "delete_volume" :: held 2.033s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:49 devstack sudo[113356]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 1G" returned: 0 in 0.882s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Created reservations ['38e2ef06-0008-46a2-907e-3f0024360be5', 'd9d19862-ae8e-4495-950b-7063fc2286dc', '00bef53b-15fa-47da-b4c8-0497038d38e4', '5fc5b46d-9182-4d20-bca9-342c12c19b6d'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[70899e67-d36b-40c0-9d19-9801ea162924]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:49 devstack sudo[113372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:49 devstack sudo[113372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:49 devstack sudo[113368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 Jun 19 04:36:49 devstack sudo[113368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Flow 'volume_create_manager' (de6b9494-cc04-423f-a209-50b30bbbb250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba60b2d9-26fd-46b6-95c1-bd63adc0f708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:49 devstack sudo[113360]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba60b2d9-26fd-46b6-95c1-bd63adc0f708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1814950936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbfa81f-0b91-4321-8c35-c74472664be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8593d73a554647b327eb361dfc5557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:50Z,use_quota=True,user_id='f6a45285180348ee883a4373e50d7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ef9be6-c4e9-4398-b0cb-e5e49c1b3c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ef9be6-c4e9-4398-b0cb-e5e49c1b3c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c36203d-c640-4c4b-9858-94bc150ffc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c36203d-c640-4c4b-9858-94bc150ffc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddbfa81f-0b91-4321-8c35-c74472664be2', 'volume_name': 'volume-ddbfa81f-0b91-4321-8c35-c74472664be2', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a049ad-8ec9-485e-bcce-323a3ec22216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27a049ad-8ec9-485e-bcce-323a3ec22216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f23057-0a27-4940-b6fb-d28218a25f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:49 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume ddbfa81f-0b91-4321-8c35-c74472664be2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddbfa81f-0b91-4321-8c35-c74472664be2', 'volume_size': 1} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1814950936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddbfa81f-0b91-4321-8c35-c74472664be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8593d73a554647b327eb361dfc5557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:50Z,use_quota=True,user_id='f6a45285180348ee883a4373e50d7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Creating volume ddbfa81f-0b91-4321-8c35-c74472664be2 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:49 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD" returned: 1 in 1.102s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] bdca5202-b14e-43d8-adf9-655d4fefc02b was raw, converting to raw {{(pid=93530) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:36:49 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:49 devstack sudo[113375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2 1073741824 Jun 19 04:36:49 devstack sudo[113375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:49 devstack sudo[113376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 Jun 19 04:36:49 devstack sudo[113376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:50 devstack sudo[113368]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:50 devstack sudo[113372]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9" returned: 0 in 0.822s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.750s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:36:50 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Deleted volume successfully. Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-a4702e41-259b-48b0-ac93-c833091364e2 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-5d5d1909-a783-40f2-9fa9-f7b4c8de1e27-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:50 devstack sudo[113384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 Jun 19 04:36:50 devstack sudo[113384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "cinder-21976ed7-9359-45ef-9c34-c7d0bae8c4c9-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-21976ed7-9359-45ef-9c34-c7d0bae8c4c9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "cinder-quobyte-21976ed7-9359-45ef-9c34-c7d0bae8c4c9" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-quobyte-21976ed7-9359-45ef-9c34-c7d0bae8c4c9" acquired by "delete_volume" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:50 devstack sudo[113376]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:50 devstack sudo[113375]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2 1073741824" returned: 0 in 0.988s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102" returned: 0 in 0.967s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bdca5202-b14e-43d8-adf9-655d4fefc02b_vv7zjbhedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:36:50 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Converted 0.00 MB image at 0.00 MB/s Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[35773487-c39d-480c-9cd8-c33773ae9456]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:50 devstack sudo[113391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 1G Jun 19 04:36:50 devstack sudo[113391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:50 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:50 devstack sudo[113394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2 Jun 19 04:36:50 devstack sudo[113394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:50 devstack sudo[113392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9 Jun 19 04:36:50 devstack sudo[113392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:51 devstack sudo[113384]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9" returned: 1 in 0.872s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Downloaded image edbba5b6-8693-4202-b81e-9eadebfe45a9 ((None, [{'url': 'file:///opt/stack/data/glance/images/edbba5b6-8693-4202-b81e-9eadebfe45a9', 'metadata': {}}])) to volume 62d30476-b93a-426c-ae5f-296a6fa060d9 successfully. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Temporary image edbba5b6-8693-4202-b81e-9eadebfe45a9 for user 8729465ba3e045c2b5d2330fe14c07d8 is deleted. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Marking volume 62d30476-b93a-426c-ae5f-296a6fa060d9 as bootable. {{(pid=93530) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Copying metadata from image edbba5b6-8693-4202-b81e-9eadebfe45a9 to 62d30476-b93a-426c-ae5f-296a6fa060d9. {{(pid=93530) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Creating volume glance metadata for volume 62d30476-b93a-426c-ae5f-296a6fa060d9 backed by image edbba5b6-8693-4202-b81e-9eadebfe45a9 with: {'image_id': 'edbba5b6-8693-4202-b81e-9eadebfe45a9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6c49422e46f7d3b43a58727baefbe146', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93530) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7f29f2-c8f4-4d5e-912b-83f684fb3909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62d30476-b93a-426c-ae5f-296a6fa060d9', 'volume_size': 1, 'image_id': 'edbba5b6-8693-4202-b81e-9eadebfe45a9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edbba5b6-8693-4202-b81e-9eadebfe45a9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6c49422e46f7d3b43a58727baefbe146', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3a65dfafd114b0c9075186f1ed0fd7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '650082f9fcf47be2b278e68cff226da6b874bb2ecda74afb875fd5b923017c143e09c73b7542928a1628eb65cdcb312db6a8fc9562158b604775020d3f5bb2f5', 'id': 'edbba5b6-8693-4202-b81e-9eadebfe45a9', 'created_at': datetime.datetime(2026, 6, 19, 2, 36, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 36, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edbba5b6-8693-4202-b81e-9eadebfe45a9/file', 'properties': {}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689a9c43-29c0-4a0b-9819-cd4dde66df06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:51 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Volume volume-62d30476-b93a-426c-ae5f-296a6fa060d9 (62d30476-b93a-426c-ae5f-296a6fa060d9): created successfully Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689a9c43-29c0-4a0b-9819-cd4dde66df06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Flow 'volume_create_manager' (42c8bd46-bf66-404a-802a-12957f5e5f87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:51 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-74835ea0-874c-47fb-b0ea-36a6c5fda262 tempest-VolumeImageDependencyTests-925415713 None] Created volume successfully. Jun 19 04:36:51 devstack sudo[113394]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2" returned: 0 in 0.729s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:51 devstack sudo[113391]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f23057-0a27-4940-b6fb-d28218a25f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddbfa81f-0b91-4321-8c35-c74472664be2', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6cb1be-1afd-4ea2-8c80-bd49e97b035c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 1G" returned: 0 in 0.822s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:51 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume volume-ddbfa81f-0b91-4321-8c35-c74472664be2 (ddbfa81f-0b91-4321-8c35-c74472664be2): created successfully Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6cb1be-1afd-4ea2-8c80-bd49e97b035c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Flow 'volume_create_manager' (de6b9494-cc04-423f-a209-50b30bbbb250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:51 devstack sudo[113392]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9" returned: 0 in 0.839s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[987fec40-0199-443d-8f25-b3dd35e28380]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:51 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-c17bcea8-d51b-46ce-9bb8-65ad28c16244 tempest-CreateVolumesFromSnapshotTest-728005157 None] Created volume successfully. Jun 19 04:36:51 devstack sudo[113408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9 Jun 19 04:36:51 devstack sudo[113408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:51 devstack sudo[113409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 Jun 19 04:36:51 devstack sudo[113409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] Creating offline snapshot 7a218ae0-43a4-468b-bf45-f78397a5af50 of volume ddbfa81f-0b91-4321-8c35-c74472664be2 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b17c9d-012b-4eaa-92ac-120be7eb02b1]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:52 devstack sudo[113412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2 Jun 19 04:36:52 devstack sudo[113412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:52 devstack sudo[113408]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-21976ed7-9359-45ef-9c34-c7d0bae8c4c9" returned: 0 in 0.696s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-quobyte-21976ed7-9359-45ef-9c34-c7d0bae8c4c9" released by "delete_volume" :: held 1.612s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Created reservations ['ec6bb0b1-6ec6-4c4e-8b7c-69eb567fe5b2', '033040d1-22fa-4ab6-97be-24751c239e4f', '1e652ff3-b513-43d0-95fb-4288cb150b8f', '35f392b2-d3c9-4d53-bffe-0ec832fa665f'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:52 devstack sudo[113409]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102" returned: 0 in 0.861s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:52 devstack sudo[113417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:52 devstack sudo[113417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:52 devstack sudo[113418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 Jun 19 04:36:52 devstack sudo[113418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Acquiring lock "cinder-62d30476-b93a-426c-ae5f-296a6fa060d9-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Lock "cinder-62d30476-b93a-426c-ae5f-296a6fa060d9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Acquiring lock "cinder-quobyte-62d30476-b93a-426c-ae5f-296a6fa060d9" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Lock "cinder-quobyte-62d30476-b93a-426c-ae5f-296a6fa060d9" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[033affa1-22f7-4376-bcc1-3dc4099b09a9]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "cinder-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:53 devstack sudo[113412]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2" returned: 0 in 1.033s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:53 devstack sudo[113425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 1G Jun 19 04:36:53 devstack sudo[113425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:53 devstack sudo[113424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "cinder-quobyte-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:53 devstack sudo[113424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-quobyte-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e2147f-bbf9-4901-9c6d-3409ab20ab48]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:53 devstack sudo[113428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8 Jun 19 04:36:53 devstack sudo[113428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:53 devstack sudo[113417]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.918s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:36:53 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Deleted volume successfully. Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c0842ec5-d7e2-4c3f-97b3-4838865877dd tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-21976ed7-9359-45ef-9c34-c7d0bae8c4c9-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:53 devstack sudo[113418]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102" returned: 1 in 1.011s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Downloaded image bdca5202-b14e-43d8-adf9-655d4fefc02b ((None, [{'url': 'file:///opt/stack/data/glance/images/bdca5202-b14e-43d8-adf9-655d4fefc02b', 'metadata': {}}])) to volume 86f44e38-10b5-467d-b968-15ceb1227102 successfully. {{(pid=93530) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Temporary image bdca5202-b14e-43d8-adf9-655d4fefc02b for user 80ceb552fa194174bfe25d906f373a53 is deleted. {{(pid=93530) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG cinder.volume.volume_utils [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Marking volume 86f44e38-10b5-467d-b968-15ceb1227102 as bootable. {{(pid=93530) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Copying metadata from image bdca5202-b14e-43d8-adf9-655d4fefc02b to 86f44e38-10b5-467d-b968-15ceb1227102. {{(pid=93530) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Creating volume glance metadata for volume 86f44e38-10b5-467d-b968-15ceb1227102 backed by image bdca5202-b14e-43d8-adf9-655d4fefc02b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bdca5202-b14e-43d8-adf9-655d4fefc02b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '1c00b2183b37e2a54ae762d17131e280', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93530) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6902f59-efeb-46e9-b65e-08e287d3b0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f44e38-10b5-467d-b968-15ceb1227102', 'volume_size': 1, 'image_id': 'bdca5202-b14e-43d8-adf9-655d4fefc02b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bdca5202-b14e-43d8-adf9-655d4fefc02b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c00b2183b37e2a54ae762d17131e280', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01626745c5254ce59764c60be1bd41e2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cf5b4ad3d72256a93addd4324b384f004c04be90e34b1723be6232fb1646d98a62c2b5a31596b6c2ff4db441c5bc33e3aa41505fbe33ce9b23ae0f620c063599', 'id': 'bdca5202-b14e-43d8-adf9-655d4fefc02b', 'created_at': datetime.datetime(2026, 6, 19, 2, 36, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 36, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bdca5202-b14e-43d8-adf9-655d4fefc02b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b05bb8-7935-4839-8a26-1e9596754c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:53 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Volume volume-86f44e38-10b5-467d-b968-15ceb1227102 (86f44e38-10b5-467d-b968-15ceb1227102): created successfully Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b05bb8-7935-4839-8a26-1e9596754c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Flow 'volume_create_manager' (4b40f395-64da-48e4-ad01-79e4eda2d396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:53 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-f4856846-00f9-4ea1-8451-fcbf7ce9e87e tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Created volume successfully. Jun 19 04:36:53 devstack sudo[113424]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9" returned: 0 in 0.989s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:54 devstack sudo[113439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 Jun 19 04:36:54 devstack sudo[113439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:54 devstack sudo[113425]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 1G" returned: 0 in 1.015s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddbfa81f-0b91-4321-8c35-c74472664be2 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:54 devstack sudo[113443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddbfa81f-0b91-4321-8c35-c74472664be2 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 Jun 19 04:36:54 devstack sudo[113443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:54 devstack sudo[113428]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8" returned: 0 in 0.994s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:54 devstack sudo[113447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8 Jun 19 04:36:54 devstack sudo[113447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:54 devstack sudo[113439]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9" returned: 1 in 0.796s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:54 devstack sudo[113455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9 Jun 19 04:36:54 devstack sudo[113455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:54 devstack sudo[113443]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddbfa81f-0b91-4321-8c35-c74472664be2 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50" returned: 0 in 0.758s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:54 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 is being set with open permissions: ugo+rw Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Acquiring lock "cinder-86f44e38-10b5-467d-b968-15ceb1227102-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:54 devstack sudo[113458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 Jun 19 04:36:54 devstack sudo[113458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Lock "cinder-86f44e38-10b5-467d-b968-15ceb1227102-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:54 devstack sudo[113447]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8" returned: 0 in 0.704s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-quobyte-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8" released by "delete_volume" :: held 1.769s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Acquiring lock "cinder-quobyte-86f44e38-10b5-467d-b968-15ceb1227102" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:54 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Lock "cinder-quobyte-86f44e38-10b5-467d-b968-15ceb1227102" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b83b515-1b79-4065-8623-9ed558143179]: (4, 'raw') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Created reservations ['b44bbf0f-aa1b-43f7-a8ec-5ff66e60da40', '1227c227-cd09-483d-b0ab-3a61e575e122', 'c3d533e2-102c-475d-b5cd-3938e31d23fe', 'd745f1ba-13dd-408d-b3c4-60fbe3fe4877'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:55 devstack sudo[113461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:55 devstack sudo[113461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:55 devstack sudo[113460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 Jun 19 04:36:55 devstack sudo[113460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "cinder-873b59fb-a4bc-44be-b348-9e99e5f56e90-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-873b59fb-a4bc-44be-b348-9e99e5f56e90-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "cinder-quobyte-873b59fb-a4bc-44be-b348-9e99e5f56e90" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-quobyte-873b59fb-a4bc-44be-b348-9e99e5f56e90" acquired by "delete_volume" :: waited 0.024s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78c144d-719d-447b-a419-d47f198dbdab]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-873b59fb-a4bc-44be-b348-9e99e5f56e90 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:55 devstack sudo[113455]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-62d30476-b93a-426c-ae5f-296a6fa060d9" returned: 0 in 0.813s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Lock "cinder-quobyte-62d30476-b93a-426c-ae5f-296a6fa060d9" released by "delete_volume" :: held 2.705s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:55 devstack sudo[113465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-873b59fb-a4bc-44be-b348-9e99e5f56e90 Jun 19 04:36:55 devstack sudo[113465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Created reservations ['52008344-1666-4f0c-bc1a-7b5c1cd9e168', 'caff2ba5-7fda-4e43-838d-0146f2b2382d', '97ac3bce-60a9-4255-b24e-e0e6a388b2c4', '2a66ad12-3c57-4608-b49c-a5bdcb2e5b3a'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:55 devstack sudo[113458]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50" returned: 0 in 0.925s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:55 devstack sudo[113468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:55 devstack sudo[113468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:55 devstack sudo[113470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.info Jun 19 04:36:55 devstack sudo[113470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:56 devstack sudo[113461]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.004s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:56 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:36:56 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Deleted volume successfully. Jun 19 04:36:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-9ae0c8a1-090b-4983-a604-5cee8a6b4fd0 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-6ba7d8db-8541-4e8b-8b7e-fc7c323034a8-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:56 devstack sudo[113460]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102" returned: 0 in 1.230s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:56 devstack sudo[113475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 Jun 19 04:36:56 devstack sudo[113475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:56 devstack sudo[113468]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.981s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:56 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:36:56 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Deleted volume successfully. Jun 19 04:36:56 devstack sudo[113465]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-873b59fb-a4bc-44be-b348-9e99e5f56e90" returned: 0 in 1.256s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-873b59fb-a4bc-44be-b348-9e99e5f56e90 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:56 devstack sudo[113482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-873b59fb-a4bc-44be-b348-9e99e5f56e90 Jun 19 04:36:56 devstack sudo[113482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-d3020fdf-88b0-49f6-9672-70d07e60cb40 tempest-VolumeImageDependencyTests-925415713 None] Lock "cinder-62d30476-b93a-426c-ae5f-296a6fa060d9-delete_volume" released by "delete_volume" :: held 4.016s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:56 devstack sudo[113470]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.info" returned: 0 in 1.004s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:56 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.info is being set with open permissions: ugo+rw Jun 19 04:36:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:56 devstack sudo[113484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.info Jun 19 04:36:56 devstack sudo[113484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:57 devstack sudo[113475]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102" returned: 1 in 1.021s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102' failed. Not Retrying. {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:36:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:57 devstack sudo[113489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102 Jun 19 04:36:57 devstack sudo[113489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:57 devstack sudo[113482]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-873b59fb-a4bc-44be-b348-9e99e5f56e90" returned: 0 in 0.815s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:57 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-quobyte-873b59fb-a4bc-44be-b348-9e99e5f56e90" released by "delete_volume" :: held 2.154s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:57 devstack sudo[113484]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.info" returned: 0 in 0.836s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.680s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:57 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-194b9283-830b-40df-ad35-0e42e472ec13 tempest-CreateVolumesFromSnapshotTest-728005157 None] Create snapshot completed successfully Jun 19 04:36:57 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Created reservations ['7401225f-000a-4f6f-bff7-62c459c86a6f', '12f51f81-af5b-40d7-876e-a20ee6ba289f', 'e4d80332-33a7-4e06-8a6a-1d0c778ba881', 'fa2b15f1-c33b-4bd4-9c09-8b86eba9ab70'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:36:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:57 devstack sudo[113493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:57 devstack sudo[113493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:58 devstack sudo[113489]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-86f44e38-10b5-467d-b968-15ceb1227102" returned: 0 in 0.798s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Lock "cinder-quobyte-86f44e38-10b5-467d-b968-15ceb1227102" released by "delete_volume" :: held 3.121s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Created reservations ['53c7f451-4d95-47a0-9e00-b630c3ac042c', '442810e6-1999-476c-9ddc-65375895f8fb', '6de2d19b-41f6-4361-bbf7-c57def12c6ef', '15bb6575-1e9d-442f-b6b3-50508308f2e1'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:58 devstack sudo[113496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:58 devstack sudo[113496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:58 devstack sudo[113493]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.784s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:36:58 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Deleted volume successfully. Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c6e5ce1-83f5-45ff-b808-21649ac51337 tempest-CreateVolumesFromSourceVolumeTest-2013018092 None] Lock "cinder-873b59fb-a4bc-44be-b348-9e99e5f56e90-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:58 devstack sudo[113499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:36:58 devstack sudo[113499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Flow 'volume_create_manager' (1fc367f0-8d4f-4839-9e4e-62d2670c91b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38deee2-04ec-4e0c-b6ba-fe3b56d33547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f38deee2-04ec-4e0c-b6ba-fe3b56d33547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1567053088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2201e76-25db-499a-b52e-e2b3bca21667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8593d73a554647b327eb361dfc5557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:59Z,use_quota=True,user_id='f6a45285180348ee883a4373e50d7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (353e9eb4-61fe-460e-bd71-7dc0cf5f6d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (353e9eb4-61fe-460e-bd71-7dc0cf5f6d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7337c59c-3644-4090-8adf-efbd6f44c378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7337c59c-3644-4090-8adf-efbd6f44c378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2201e76-25db-499a-b52e-e2b3bca21667', 'volume_name': 'volume-f2201e76-25db-499a-b52e-e2b3bca21667', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82831f0b-0a68-44b0-a6d7-4b63ddd1bb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82831f0b-0a68-44b0-a6d7-4b63ddd1bb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5c8905-fe3d-43ba-9b1a-50a1a2ec7460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:59 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume f2201e76-25db-499a-b52e-e2b3bca21667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2201e76-25db-499a-b52e-e2b3bca21667', 'volume_size': 1} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1567053088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2201e76-25db-499a-b52e-e2b3bca21667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8593d73a554647b327eb361dfc5557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:36:59Z,use_quota=True,user_id='f6a45285180348ee883a4373e50d7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Creating volume f2201e76-25db-499a-b52e-e2b3bca21667 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:36:59 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f2201e76-25db-499a-b52e-e2b3bca21667 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:36:59 devstack sudo[113502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f2201e76-25db-499a-b52e-e2b3bca21667 1073741824 Jun 19 04:36:59 devstack sudo[113502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:36:59 devstack sudo[113496]: pam_unix(sudo:session): session closed for user root Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.292s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:36:59 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Deleted volume successfully. Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6bf86164-9dd5-405b-ad96-e80eb32ca5ce tempest-VolumeAndVolumeTypeFromImageTest-867356667 None] Lock "cinder-86f44e38-10b5-467d-b968-15ceb1227102-delete_volume" released by "delete_volume" :: held 4.753s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Flow 'volume_create_manager' (b0e2dfcb-cc2f-4e1c-b839-dc9fb461b6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79e9cb1-c30c-4ca8-8452-32f8f69fa5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79e9cb1-c30c-4ca8-8452-32f8f69fa5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319532069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388c25af-2071-45d6-b639-14f84fd2307e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8593d73a554647b327eb361dfc5557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:00Z,use_quota=True,user_id='f6a45285180348ee883a4373e50d7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746d3905-a4b8-48dc-99eb-7bf6b10bf2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:36:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746d3905-a4b8-48dc-99eb-7bf6b10bf2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfe9272-fbd8-466f-a336-ba79eea6257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfe9272-fbd8-466f-a336-ba79eea6257b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '388c25af-2071-45d6-b639-14f84fd2307e', 'volume_name': 'volume-388c25af-2071-45d6-b639-14f84fd2307e', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93de6fe-611e-49b3-af20-1c6a322e25d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93de6fe-611e-49b3-af20-1c6a322e25d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb858f75-efe9-46f3-b65d-041366aff5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:00 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume 388c25af-2071-45d6-b639-14f84fd2307e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-388c25af-2071-45d6-b639-14f84fd2307e', 'volume_size': 1} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:00 devstack sudo[113499]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.280s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Flow 'volume_create_manager' (9be43e9a-9a16-471b-a519-35a65a9baa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbdcf8fa-7736-4b1b-b81b-23056376a93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbdcf8fa-7736-4b1b-b81b-23056376a93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1939661041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c70013-4f5e-4922-a905-8b413560bade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8593d73a554647b327eb361dfc5557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:00Z,use_quota=True,user_id='f6a45285180348ee883a4373e50d7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ba348f-c78d-417a-8f0f-712b6ae5e1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2ba348f-c78d-417a-8f0f-712b6ae5e1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f673ffe3-281f-4631-be12-a6d606c7b4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f673ffe3-281f-4631-be12-a6d606c7b4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43c70013-4f5e-4922-a905-8b413560bade', 'volume_name': 'volume-43c70013-4f5e-4922-a905-8b413560bade', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccce544-844c-423a-83f0-a1532dbb09b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fccce544-844c-423a-83f0-a1532dbb09b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5d5e52-208f-45e2-aa0b-5dbb78bed843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:00 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume 43c70013-4f5e-4922-a905-8b413560bade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43c70013-4f5e-4922-a905-8b413560bade', 'volume_size': 1} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:00 devstack sudo[113502]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f2201e76-25db-499a-b52e-e2b3bca21667 1073741824" returned: 0 in 1.525s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f2201e76-25db-499a-b52e-e2b3bca21667 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:00 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Flow 'volume_create_manager' (9351144e-ee54-4efb-a84b-98f125d06ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c518e9-27b4-4ec2-9f12-624d1975dbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:01 devstack sudo[113510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f2201e76-25db-499a-b52e-e2b3bca21667 Jun 19 04:37:01 devstack sudo[113510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5c518e9-27b4-4ec2-9f12-624d1975dbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-524635670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eadf91b-cc76-4f2c-b347-7ac4cc7bd134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8593d73a554647b327eb361dfc5557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:01Z,use_quota=True,user_id='f6a45285180348ee883a4373e50d7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae383948-4fe2-4209-b19a-7e73df820370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae383948-4fe2-4209-b19a-7e73df820370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cf99e4-455c-48c4-b499-bfb3a3651f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cf99e4-455c-48c4-b499-bfb3a3651f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eadf91b-cc76-4f2c-b347-7ac4cc7bd134', 'volume_name': 'volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68c64a7-31fb-440a-a60a-e67d519e68f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68c64a7-31fb-440a-a60a-e67d519e68f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39e56be-9f09-4be9-9c41-a4e6bac5cc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:01 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume 8eadf91b-cc76-4f2c-b347-7ac4cc7bd134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134', 'volume_size': 1} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Flow 'volume_create_manager' (0375be63-9574-4d47-95f7-6f7855b4bb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903d38c5-001b-41e8-b47c-56bf21dd6d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903d38c5-001b-41e8-b47c-56bf21dd6d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1443889422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b08a3a-f6fa-4cf9-8495-1a0250f15437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8593d73a554647b327eb361dfc5557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:02Z,use_quota=True,user_id='f6a45285180348ee883a4373e50d7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65433388-d98d-4f1c-9175-fc60b8fc1796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65433388-d98d-4f1c-9175-fc60b8fc1796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3561a6f-6e99-4ec5-8ec0-48738cbaadf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3561a6f-6e99-4ec5-8ec0-48738cbaadf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b08a3a-f6fa-4cf9-8495-1a0250f15437', 'volume_name': 'volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f08d961-8549-4a5d-9c3e-2cfa3875f676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f08d961-8549-4a5d-9c3e-2cfa3875f676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4e2ccf-31a0-4693-ab8d-2dd7c910bb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:01 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume d7b08a3a-f6fa-4cf9-8495-1a0250f15437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437', 'volume_size': 1} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Flow 'volume_create_manager' (c5751c1d-b64d-4fa8-ae1f-ee4ef816ef6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:01 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f373e26-9c75-464a-919c-352fa76caf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f373e26-9c75-464a-919c-352fa76caf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da67ee30-b3f4-42e4-adb6-e966f0c6017d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dfdfe7afed4471b78576ea5b207920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:02Z,use_quota=True,user_id='7923363b3a5140be9050894b0d920026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea455532-a66b-4e97-a9d4-9f3881cce835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea455532-a66b-4e97-a9d4-9f3881cce835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db915be-79e1-4d2c-a9da-78cc4eee39f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db915be-79e1-4d2c-a9da-78cc4eee39f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da67ee30-b3f4-42e4-adb6-e966f0c6017d', 'volume_name': 'volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e4a1d1-e8f5-48c1-8e65-9676f179d4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e4a1d1-e8f5-48c1-8e65-9676f179d4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f5d1fb-a21b-44b0-a6a4-7376b600c20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:02 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Volume da67ee30-b3f4-42e4-adb6-e966f0c6017d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d', 'volume_size': 1} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:02 devstack sudo[113510]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f2201e76-25db-499a-b52e-e2b3bca21667" returned: 0 in 1.161s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] <== create_volume: return (2781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.784s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.090s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319532069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388c25af-2071-45d6-b639-14f84fd2307e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8593d73a554647b327eb361dfc5557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:00Z,use_quota=True,user_id='f6a45285180348ee883a4373e50d7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Creating volume 388c25af-2071-45d6-b639-14f84fd2307e {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:37:02 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-388c25af-2071-45d6-b639-14f84fd2307e 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b5c8905-fe3d-43ba-9b1a-50a1a2ec7460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2201e76-25db-499a-b52e-e2b3bca21667', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:02 devstack sudo[113514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-388c25af-2071-45d6-b639-14f84fd2307e 1073741824 Jun 19 04:37:02 devstack sudo[113514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e350b4-a8eb-42ca-b337-aead8ccc1151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:02 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume volume-f2201e76-25db-499a-b52e-e2b3bca21667 (f2201e76-25db-499a-b52e-e2b3bca21667): created successfully Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e350b4-a8eb-42ca-b337-aead8ccc1151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:02 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Flow 'volume_create_manager' (1fc367f0-8d4f-4839-9e4e-62d2670c91b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:02 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ad7c6c89-c448-464d-a184-8b7a6d8304fd tempest-CreateVolumesFromSnapshotTest-728005157 None] Created volume successfully. Jun 19 04:37:03 devstack sudo[113514]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-388c25af-2071-45d6-b639-14f84fd2307e 1073741824" returned: 0 in 1.011s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-388c25af-2071-45d6-b639-14f84fd2307e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:03 devstack sudo[113520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-388c25af-2071-45d6-b639-14f84fd2307e Jun 19 04:37:03 devstack sudo[113520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Flow 'volume_create_manager' (281ba8cf-a61b-46c4-b259-7beb7ec284f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58aff1df-0945-47fe-ae02-98b9ce935d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58aff1df-0945-47fe-ae02-98b9ce935d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1782988246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b898a27-98b7-4e95-8abb-b9a049a99959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49c2cd0c11043fe94d537197e8b1a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:04Z,use_quota=True,user_id='3d3f222bfa994e1293adac6eb49833b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b274342-62ce-4ed4-88de-0395d4c4fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b274342-62ce-4ed4-88de-0395d4c4fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885b6680-0340-45cf-ad1d-625ed438a7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (885b6680-0340-45cf-ad1d-625ed438a7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b898a27-98b7-4e95-8abb-b9a049a99959', 'volume_name': 'volume-8b898a27-98b7-4e95-8abb-b9a049a99959', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d48946a-ea12-4e2d-9f57-9bed964046dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d48946a-ea12-4e2d-9f57-9bed964046dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dfa057b-2a61-4b16-8f00-15e708571c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:03 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Volume 8b898a27-98b7-4e95-8abb-b9a049a99959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b898a27-98b7-4e95-8abb-b9a049a99959', 'volume_size': 1} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:03 devstack sudo[113520]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-388c25af-2071-45d6-b639-14f84fd2307e" returned: 0 in 0.780s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.583s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1939661041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c70013-4f5e-4922-a905-8b413560bade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8593d73a554647b327eb361dfc5557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:00Z,use_quota=True,user_id='f6a45285180348ee883a4373e50d7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Creating volume 43c70013-4f5e-4922-a905-8b413560bade {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:37:03 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:37:03 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-43c70013-4f5e-4922-a905-8b413560bade 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:04 devstack sudo[113523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-43c70013-4f5e-4922-a905-8b413560bade 1073741824 Jun 19 04:37:04 devstack sudo[113523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb858f75-efe9-46f3-b65d-041366aff5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-388c25af-2071-45d6-b639-14f84fd2307e', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43427bb-cf3e-457e-8320-cc04c20afb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:04 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume volume-388c25af-2071-45d6-b639-14f84fd2307e (388c25af-2071-45d6-b639-14f84fd2307e): created successfully Jun 19 04:37:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43427bb-cf3e-457e-8320-cc04c20afb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:04 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Flow 'volume_create_manager' (b0e2dfcb-cc2f-4e1c-b839-dc9fb461b6b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:04 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-5bf828a8-c43d-4359-b0be-deafd40a2497 tempest-CreateVolumesFromSnapshotTest-728005157 None] Created volume successfully. Jun 19 04:37:04 devstack sudo[113523]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-43c70013-4f5e-4922-a905-8b413560bade 1073741824" returned: 0 in 0.932s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:04 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-43c70013-4f5e-4922-a905-8b413560bade {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:05 devstack sudo[113529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-43c70013-4f5e-4922-a905-8b413560bade Jun 19 04:37:05 devstack sudo[113529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:05 devstack sudo[113529]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-43c70013-4f5e-4922-a905-8b413560bade" returned: 0 in 0.692s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.488s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-524635670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eadf91b-cc76-4f2c-b347-7ac4cc7bd134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8593d73a554647b327eb361dfc5557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:01Z,use_quota=True,user_id='f6a45285180348ee883a4373e50d7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Creating volume 8eadf91b-cc76-4f2c-b347-7ac4cc7bd134 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:37:05 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:05 devstack sudo[113532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134 1073741824 Jun 19 04:37:05 devstack sudo[113532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5d5e52-208f-45e2-aa0b-5dbb78bed843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43c70013-4f5e-4922-a905-8b413560bade', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e459c7f-97fd-413f-ae8e-5c2a06d392e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:05 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume volume-43c70013-4f5e-4922-a905-8b413560bade (43c70013-4f5e-4922-a905-8b413560bade): created successfully Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e459c7f-97fd-413f-ae8e-5c2a06d392e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:05 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Flow 'volume_create_manager' (9be43e9a-9a16-471b-a519-35a65a9baa78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:05 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-cfb3f6bd-bd5b-47e7-b19d-fdfbdb781873 tempest-CreateVolumesFromSnapshotTest-728005157 None] Created volume successfully. Jun 19 04:37:06 devstack sudo[113532]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134 1073741824" returned: 0 in 0.850s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:06 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:06 devstack sudo[113537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134 Jun 19 04:37:06 devstack sudo[113537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:07 devstack sudo[113537]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134" returned: 0 in 0.688s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.505s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1443889422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b08a3a-f6fa-4cf9-8495-1a0250f15437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8593d73a554647b327eb361dfc5557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:02Z,use_quota=True,user_id='f6a45285180348ee883a4373e50d7378',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Creating volume d7b08a3a-f6fa-4cf9-8495-1a0250f15437 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:37:07 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39e56be-9f09-4be9-9c41-a4e6bac5cc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:07 devstack sudo[113541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437 1073741824 Jun 19 04:37:07 devstack sudo[113541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f691174-a1de-4505-ab5c-691eb0286b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:07 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134 (8eadf91b-cc76-4f2c-b347-7ac4cc7bd134): created successfully Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f691174-a1de-4505-ab5c-691eb0286b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:07 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Flow 'volume_create_manager' (9351144e-ee54-4efb-a84b-98f125d06ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:07 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-9dddbfe6-e9a3-4bae-929c-6a941a9b8b8e tempest-CreateVolumesFromSnapshotTest-728005157 None] Created volume successfully. Jun 19 04:37:08 devstack sudo[113541]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437 1073741824" returned: 0 in 0.927s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:08 devstack sudo[113548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437 Jun 19 04:37:08 devstack sudo[113548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:08 devstack sudo[113548]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437" returned: 0 in 0.711s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.914s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da67ee30-b3f4-42e4-adb6-e966f0c6017d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dfdfe7afed4471b78576ea5b207920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:02Z,use_quota=True,user_id='7923363b3a5140be9050894b0d920026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Creating volume da67ee30-b3f4-42e4-adb6-e966f0c6017d {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:37:08 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:37:08 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4e2ccf-31a0-4693-ab8d-2dd7c910bb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:09 devstack sudo[113551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d 1073741824 Jun 19 04:37:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a77964-1016-485e-a511-52e5e99cd2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:09 devstack sudo[113551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:09 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Volume volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437 (d7b08a3a-f6fa-4cf9-8495-1a0250f15437): created successfully Jun 19 04:37:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a77964-1016-485e-a511-52e5e99cd2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:09 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Flow 'volume_create_manager' (0375be63-9574-4d47-95f7-6f7855b4bb8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:09 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-b37c5c12-70ce-438f-9a0d-3b20939a00e1 tempest-CreateVolumesFromSnapshotTest-728005157 None] Created volume successfully. Jun 19 04:37:09 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-d7b08a3a-f6fa-4cf9-8495-1a0250f15437-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:09 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-d7b08a3a-f6fa-4cf9-8495-1a0250f15437-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:09 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-quobyte-d7b08a3a-f6fa-4cf9-8495-1a0250f15437" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:09 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-d7b08a3a-f6fa-4cf9-8495-1a0250f15437" acquired by "delete_volume" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:09 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[8679f68e-7b8e-4d5b-a7d9-e92f5bcce8d8]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:09 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:09 devstack sudo[113553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437 Jun 19 04:37:09 devstack sudo[113553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:10 devstack sudo[113551]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d 1073741824" returned: 0 in 1.183s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:10 devstack sudo[113563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d Jun 19 04:37:10 devstack sudo[113563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:10 devstack sudo[113553]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437" returned: 0 in 0.957s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:10 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:10 devstack sudo[113568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437 Jun 19 04:37:10 devstack sudo[113568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:11 devstack sudo[113563]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d" returned: 0 in 0.960s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.311s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1782988246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b898a27-98b7-4e95-8abb-b9a049a99959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49c2cd0c11043fe94d537197e8b1a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:04Z,use_quota=True,user_id='3d3f222bfa994e1293adac6eb49833b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Creating volume 8b898a27-98b7-4e95-8abb-b9a049a99959 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:37:11 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f5d1fb-a21b-44b0-a6a4-7376b600c20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:11 devstack sudo[113571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 1073741824 Jun 19 04:37:11 devstack sudo[113571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adeb5ddf-854b-463c-8816-b48753f1683f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:11 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Volume volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d (da67ee30-b3f4-42e4-adb6-e966f0c6017d): created successfully Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adeb5ddf-854b-463c-8816-b48753f1683f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Flow 'volume_create_manager' (c5751c1d-b64d-4fa8-ae1f-ee4ef816ef6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:11 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-27ad48cd-b45d-468d-a128-592c413afa96 tempest-CinderUnicodeTest-1135811386 None] Created volume successfully. Jun 19 04:37:11 devstack sudo[113568]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-d7b08a3a-f6fa-4cf9-8495-1a0250f15437" returned: 0 in 0.871s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-d7b08a3a-f6fa-4cf9-8495-1a0250f15437" released by "delete_volume" :: held 1.901s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Created reservations ['6a6129c7-fff5-4033-9d1f-a3df18db09fb', '0205ecfd-2766-43d9-9490-a064509c9ab3', '6e814f00-4338-45b0-9e53-cbe300e3dca2', 'fd746918-69b9-4c76-b944-923bf13081ff'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:11 devstack sudo[113575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:37:11 devstack sudo[113575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:11 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-quobyte-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134" acquired by "delete_volume" :: waited 0.034s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6aa151-9854-48c2-9070-cdbf70f476ac]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:12 devstack sudo[113577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134 Jun 19 04:37:12 devstack sudo[113577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:12 devstack sudo[113571]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Flow 'volume_create_manager' (d8bc88eb-87f1-4a42-a992-e335b79d39e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aeb8074-e0d3-4a34-8a2d-f646d215c4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 1073741824" returned: 0 in 1.598s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:12 devstack sudo[113575]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.103s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aeb8074-e0d3-4a34-8a2d-f646d215c4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1261161541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81bc0563-f8b2-4f69-9258-6a75f5efd155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dfdfe7afed4471b78576ea5b207920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:13Z,use_quota=True,user_id='7923363b3a5140be9050894b0d920026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6dc4f6-3fe1-4b91-a407-54a3fd41f769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6dc4f6-3fe1-4b91-a407-54a3fd41f769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d3ff61-f586-4070-9839-c940b683b7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d3ff61-f586-4070-9839-c940b683b7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81bc0563-f8b2-4f69-9258-6a75f5efd155', 'volume_name': 'volume-81bc0563-f8b2-4f69-9258-6a75f5efd155', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a63f77-7ed3-4d3c-b9b1-24251eba1963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42a63f77-7ed3-4d3c-b9b1-24251eba1963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d984d25d-7008-4067-8df0-af2fc35a77d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:12 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Volume 81bc0563-f8b2-4f69-9258-6a75f5efd155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81bc0563-f8b2-4f69-9258-6a75f5efd155', 'volume_size': 1} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:12 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Deleted volume successfully. Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:12 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-67135aa2-2cbd-43af-a496-323ad317a640 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-d7b08a3a-f6fa-4cf9-8495-1a0250f15437-delete_volume" released by "delete_volume" :: held 3.424s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:12 devstack sudo[113583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 Jun 19 04:37:12 devstack sudo[113583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:13 devstack sudo[113577]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134" returned: 0 in 1.274s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:13 devstack sudo[113588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134 Jun 19 04:37:13 devstack sudo[113588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:13 devstack sudo[113583]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959" returned: 0 in 0.888s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] <== create_volume: return (2607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.620s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.923s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1261161541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81bc0563-f8b2-4f69-9258-6a75f5efd155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77dfdfe7afed4471b78576ea5b207920',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:13Z,use_quota=True,user_id='7923363b3a5140be9050894b0d920026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Creating volume 81bc0563-f8b2-4f69-9258-6a75f5efd155 {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:37:13 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:13 devstack sudo[113591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 1073741824 Jun 19 04:37:13 devstack sudo[113591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dfa057b-2a61-4b16-8f00-15e708571c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b898a27-98b7-4e95-8abb-b9a049a99959', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f91d3b-bcb4-4ce8-a2e8-9020ab4a0399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:13 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Volume volume-8b898a27-98b7-4e95-8abb-b9a049a99959 (8b898a27-98b7-4e95-8abb-b9a049a99959): created successfully Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4f91d3b-bcb4-4ce8-a2e8-9020ab4a0399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:13 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Flow 'volume_create_manager' (281ba8cf-a61b-46c4-b259-7beb7ec284f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:13 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-fb68ca85-8880-4f4e-9761-486bafe4c744 tempest-VolumeDependencyTests-716483202 None] Created volume successfully. Jun 19 04:37:14 devstack sudo[113588]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134" returned: 0 in 0.834s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:14 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134" released by "delete_volume" :: held 2.186s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:14 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Created reservations ['49e88d25-f828-43e9-b049-102deaf48c0c', 'bdbb1a79-5429-4b97-923a-32718e6806e0', '442bcd72-4c75-4830-a253-b688b0f42826', '20351f14-68a0-4f21-b381-aed641597b52'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:14 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:14 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:14 devstack sudo[113594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:37:14 devstack sudo[113594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:14 devstack sudo[113591]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 1073741824" returned: 0 in 1.049s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:14 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:14 devstack sudo[113599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 Jun 19 04:37:14 devstack sudo[113599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:15 devstack sudo[113594]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.793s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:37:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Deleted volume successfully. Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-81e9acc0-10c7-4db3-99d2-ebbd2280c43c tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-8eadf91b-cc76-4f2c-b347-7ac4cc7bd134-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-43c70013-4f5e-4922-a905-8b413560bade-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-43c70013-4f5e-4922-a905-8b413560bade-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-quobyte-43c70013-4f5e-4922-a905-8b413560bade" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-43c70013-4f5e-4922-a905-8b413560bade" acquired by "delete_volume" :: waited 0.027s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[786b054d-efb3-4e9f-85a1-23ec18451545]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-43c70013-4f5e-4922-a905-8b413560bade {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:15 devstack sudo[113602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-43c70013-4f5e-4922-a905-8b413560bade Jun 19 04:37:15 devstack sudo[113602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:15 devstack sudo[113599]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155" returned: 0 in 0.788s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.923s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d984d25d-7008-4067-8df0-af2fc35a77d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81bc0563-f8b2-4f69-9258-6a75f5efd155', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4598f9-3624-45d9-96f8-fae46c3800db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] Creating offline snapshot 258b34b5-03b4-4798-a2c7-5fa0f352f8ba of volume 8b898a27-98b7-4e95-8abb-b9a049a99959 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b2c2fa-c187-41d7-8e8b-8abb62d2bf16]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:15 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Volume volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 (81bc0563-f8b2-4f69-9258-6a75f5efd155): created successfully Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4598f9-3624-45d9-96f8-fae46c3800db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:15 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Flow 'volume_create_manager' (d8bc88eb-87f1-4a42-a992-e335b79d39e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:15 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-6798654d-80e7-42c6-a8f3-9208e23357d2 tempest-CinderUnicodeTest-1135811386 None] Created volume successfully. Jun 19 04:37:15 devstack sudo[113605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 Jun 19 04:37:15 devstack sudo[113605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:16 devstack sudo[113602]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-43c70013-4f5e-4922-a905-8b413560bade" returned: 0 in 0.978s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-43c70013-4f5e-4922-a905-8b413560bade {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:16 devstack sudo[113610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-43c70013-4f5e-4922-a905-8b413560bade Jun 19 04:37:16 devstack sudo[113610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:16 devstack sudo[113605]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959" returned: 0 in 0.916s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:16 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:16 devstack sudo[113615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba 1G Jun 19 04:37:16 devstack sudo[113615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:17 devstack sudo[113610]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-43c70013-4f5e-4922-a905-8b413560bade" returned: 0 in 0.707s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-43c70013-4f5e-4922-a905-8b413560bade" released by "delete_volume" :: held 1.740s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Created reservations ['77f0fa89-a596-49d4-8a07-943ebe5dfbbd', '5794a964-1ddf-4037-bee4-36327dd5cba1', '7b5d61eb-8407-4256-b70a-ebf1ed481bbc', '14b9554f-5a92-4b48-ad1a-067a64f0eac5'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:17 devstack sudo[113618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:37:17 devstack sudo[113618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-388c25af-2071-45d6-b639-14f84fd2307e-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-388c25af-2071-45d6-b639-14f84fd2307e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-quobyte-388c25af-2071-45d6-b639-14f84fd2307e" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-388c25af-2071-45d6-b639-14f84fd2307e" acquired by "delete_volume" :: waited 0.021s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[3757ebc6-c10e-439e-b4b7-5510c32b95eb]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-388c25af-2071-45d6-b639-14f84fd2307e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:17 devstack sudo[113615]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba 1G" returned: 0 in 1.090s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:17 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b898a27-98b7-4e95-8abb-b9a049a99959 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:17 devstack sudo[113623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-388c25af-2071-45d6-b639-14f84fd2307e Jun 19 04:37:17 devstack sudo[113623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:17 devstack sudo[113625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b898a27-98b7-4e95-8abb-b9a049a99959 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba Jun 19 04:37:17 devstack sudo[113625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:18 devstack sudo[113618]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.783s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:18 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:37:18 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Deleted volume successfully. Jun 19 04:37:18 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-fbbfdfc6-38f6-4424-8fee-6f20138f581a tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-43c70013-4f5e-4922-a905-8b413560bade-delete_volume" released by "delete_volume" :: held 2.821s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:18 devstack sudo[113623]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-388c25af-2071-45d6-b639-14f84fd2307e" returned: 0 in 0.942s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-388c25af-2071-45d6-b639-14f84fd2307e {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:18 devstack sudo[113625]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b898a27-98b7-4e95-8abb-b9a049a99959 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba" returned: 0 in 0.864s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:18 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba is being set with open permissions: ugo+rw Jun 19 04:37:18 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:18 devstack sudo[113635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-388c25af-2071-45d6-b639-14f84fd2307e Jun 19 04:37:18 devstack sudo[113635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:18 devstack sudo[113636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba Jun 19 04:37:18 devstack sudo[113636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:19 devstack sudo[113636]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:19 devstack sudo[113635]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba" returned: 0 in 0.658s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-388c25af-2071-45d6-b639-14f84fd2307e" returned: 0 in 0.700s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=142,cinder:UPDATE=206,cinder:INSERT=58,cinder:DELETE=18 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-388c25af-2071-45d6-b639-14f84fd2307e" released by "delete_volume" :: held 1.699s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:19 devstack sudo[113641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.info Jun 19 04:37:19 devstack sudo[113641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Created reservations ['47edaf4c-7210-44f8-af45-da28d45f9837', 'b86683e3-0f76-403c-82bb-9b1100e9cdb3', 'a60ee697-3f5b-4682-80a2-fb6faca7c67d', 'b9751574-79f0-4be7-82be-be4dcd317ee7'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:19 devstack sudo[113643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:37:19 devstack sudo[113643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-f2201e76-25db-499a-b52e-e2b3bca21667-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-f2201e76-25db-499a-b52e-e2b3bca21667-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:19 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:UPDATE=203,cinder:SELECT=150,cinder:DELETE=21,cinder:INSERT=52 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:37:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-quobyte-f2201e76-25db-499a-b52e-e2b3bca21667" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-f2201e76-25db-499a-b52e-e2b3bca21667" acquired by "delete_volume" :: waited 0.030s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:20 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[153e688b-8c51-45af-8744-a405839c05ab]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f2201e76-25db-499a-b52e-e2b3bca21667 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:20 devstack sudo[113645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f2201e76-25db-499a-b52e-e2b3bca21667 Jun 19 04:37:20 devstack sudo[113645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:20 devstack sudo[113641]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.info" returned: 0 in 1.062s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:20 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.info is being set with open permissions: ugo+rw Jun 19 04:37:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:20 devstack sudo[113649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.info Jun 19 04:37:20 devstack sudo[113649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:20 devstack sudo[113643]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:20 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.004s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:20 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:37:20 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Deleted volume successfully. Jun 19 04:37:20 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-43c58563-a0ff-44e5-8e21-37204201877b tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-388c25af-2071-45d6-b639-14f84fd2307e-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:21 devstack sudo[113645]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f2201e76-25db-499a-b52e-e2b3bca21667" returned: 0 in 0.868s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f2201e76-25db-499a-b52e-e2b3bca21667 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:21 devstack sudo[113655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f2201e76-25db-499a-b52e-e2b3bca21667 Jun 19 04:37:21 devstack sudo[113655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:21 devstack sudo[113649]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.info" returned: 0 in 0.747s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.496s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.820s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] Creating offline snapshot 442d0a85-515e-4833-bbaa-7de1131dbed4 of volume 81bc0563-f8b2-4f69-9258-6a75f5efd155 {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:37:21 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-e4a4627d-3c42-4a47-94d2-3bcb18c1f228 tempest-VolumeDependencyTests-716483202 None] Create snapshot completed successfully Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a36fce8-69b8-4bc0-99e3-6854cd4bb515]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:21 devstack sudo[113657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 Jun 19 04:37:21 devstack sudo[113657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:21 devstack sudo[113655]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-f2201e76-25db-499a-b52e-e2b3bca21667" returned: 0 in 0.747s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-f2201e76-25db-499a-b52e-e2b3bca21667" released by "delete_volume" :: held 1.684s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Created reservations ['c4b41d62-5341-4fde-a8c8-0fed23326289', 'b3c05881-685b-4625-bc83-82c9af987327', '979207c5-54fb-4a56-9ff9-19629581c7f6', '27f527e2-c29c-404e-9bcb-1ea3dbc723cd'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:21 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:22 devstack sudo[113664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:37:22 devstack sudo[113664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:22 devstack sudo[113657]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155" returned: 0 in 0.793s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:22 devstack sudo[113666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 1G Jun 19 04:37:22 devstack sudo[113666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-7a218ae0-43a4-468b-bf45-f78397a5af50-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-7a218ae0-43a4-468b-bf45-f78397a5af50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-quobyte-ddbfa81f-0b91-4321-8c35-c74472664be2" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-ddbfa81f-0b91-4321-8c35-c74472664be2" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-quobyte-7a218ae0-43a4-468b-bf45-f78397a5af50" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:22 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-7a218ae0-43a4-468b-bf45-f78397a5af50" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Deleting offline snapshot 7a218ae0-43a4-468b-bf45-f78397a5af50 of volume ddbfa81f-0b91-4321-8c35-c74472664be2 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:37:22 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] snapshot_file for this snap is: volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:37:22 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[370c18ca-e669-41ae-9df0-aeecedeccb81]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:22 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:22 devstack sudo[113668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 Jun 19 04:37:22 devstack sudo[113668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:23 devstack sudo[113664]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 1.124s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:37:23 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Deleted volume successfully. Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-6543e9f7-ab16-4b51-b9ed-66e9323d91fb tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-f2201e76-25db-499a-b52e-e2b3bca21667-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:23 devstack sudo[113666]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 1G" returned: 0 in 1.141s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Flow 'volume_create_manager' (86f80e80-8b86-4dfa-a89c-8252c2e21736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c8d6e29-dce9-4b93-8edd-3d97fcf1c58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:23 devstack sudo[113674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 Jun 19 04:37:23 devstack sudo[113674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c8d6e29-dce9-4b93-8edd-3d97fcf1c58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1516681429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2285c2-e12b-44ae-b70e-300578a8be8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49c2cd0c11043fe94d537197e8b1a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=258b34b5-03b4-4798-a2c7-5fa0f352f8ba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:23Z,use_quota=True,user_id='3d3f222bfa994e1293adac6eb49833b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c968b0-b46f-4bc9-bfe9-c1d3ff207ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c968b0-b46f-4bc9-bfe9-c1d3ff207ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa39742-63bf-40fc-91b4-d3b4ec6151ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fa39742-63bf-40fc-91b4-d3b4ec6151ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5a2285c2-e12b-44ae-b70e-300578a8be8b', 'volume_name': 'volume-5a2285c2-e12b-44ae-b70e-300578a8be8b', 'volume_size': 1, 'snapshot_id': '258b34b5-03b4-4798-a2c7-5fa0f352f8ba'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e867c64-1422-45a5-b095-eaf4f115180f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e867c64-1422-45a5-b095-eaf4f115180f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705057ad-8a79-4f47-9379-ac5112f8cacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:23 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Volume 5a2285c2-e12b-44ae-b70e-300578a8be8b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5a2285c2-e12b-44ae-b70e-300578a8be8b', 'volume_size': 1, 'snapshot_id': '258b34b5-03b4-4798-a2c7-5fa0f352f8ba'} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:23 devstack sudo[113668]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50" returned: 0 in 1.180s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddbfa81f-0b91-4321-8c35-c74472664be2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[566a09db-861c-4875-a378-4531ee681973]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:23 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:23 devstack sudo[113679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2 Jun 19 04:37:23 devstack sudo[113679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:24 devstack sudo[113674]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4" returned: 0 in 0.880s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:24 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 is being set with open permissions: ugo+rw Jun 19 04:37:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:24 devstack sudo[113685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 Jun 19 04:37:24 devstack sudo[113685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:24 devstack sudo[113679]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2" returned: 0 in 0.955s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:24 devstack sudo[113696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 Jun 19 04:37:24 devstack sudo[113696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:24 devstack sudo[113685]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4" returned: 0 in 0.748s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:24 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:24 devstack sudo[113699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.info Jun 19 04:37:24 devstack sudo[113699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:25 devstack sudo[113696]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50" returned: 0 in 0.848s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:25 devstack sudo[113706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50 Jun 19 04:37:25 devstack sudo[113706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:25 devstack sudo[113699]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.info" returned: 0 in 0.722s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:25 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.info is being set with open permissions: ugo+rw Jun 19 04:37:25 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:25 devstack sudo[113708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.info Jun 19 04:37:25 devstack sudo[113708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:26 devstack sudo[113706]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2.7a218ae0-43a4-468b-bf45-f78397a5af50" returned: 0 in 0.759s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-7a218ae0-43a4-468b-bf45-f78397a5af50" released by "_delete_snapshot" :: held 3.913s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-ddbfa81f-0b91-4321-8c35-c74472664be2" released by "delete_snapshot" :: held 3.950s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Created reservations ['e6518f60-e9c6-4923-8905-2ffe77bc176d', '0c9977ca-28fd-4c04-ac89-fe67e400a121', '4fc73c09-7f43-4c84-9117-bdaa153c7d16', '64e3d072-bc8d-4ef6-b7cd-308e5ef40b08'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:26 devstack sudo[113708]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.info" returned: 0 in 0.797s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.196s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.093s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Acquiring lock "cinder-quobyte-258b34b5-03b4-4798-a2c7-5fa0f352f8ba-5a2285c2-e12b-44ae-b70e-300578a8be8b" by "_create_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Lock "cinder-quobyte-258b34b5-03b4-4798-a2c7-5fa0f352f8ba-5a2285c2-e12b-44ae-b70e-300578a8be8b" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Creating volume 5a2285c2-e12b-44ae-b70e-300578a8be8b from snapshot 258b34b5-03b4-4798-a2c7-5fa0f352f8ba {{(pid=93530) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Acquiring lock "cinder-quobyte-5a2285c2-e12b-44ae-b70e-300578a8be8b" by "_copy_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:26 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-1489bf6d-136e-4504-b4be-5e8f1a36f38c tempest-CinderUnicodeTest-1135811386 None] Create snapshot completed successfully Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Lock "cinder-quobyte-5a2285c2-e12b-44ae-b70e-300578a8be8b" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] snapshot: 258b34b5-03b4-4798-a2c7-5fa0f352f8ba, volume: 5a2285c2-e12b-44ae-b70e-300578a8be8b, {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:26 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Delete snapshot completed successfully. Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-105e410b-39ad-438c-b7d5-65ef56c45d2a tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-7a218ae0-43a4-468b-bf45-f78397a5af50-delete_snapshot" released by "delete_snapshot" :: held 4.229s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21cc394-9928-490b-865d-56edd67f20c6]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-ddbfa81f-0b91-4321-8c35-c74472664be2-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-ddbfa81f-0b91-4321-8c35-c74472664be2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "cinder-quobyte-ddbfa81f-0b91-4321-8c35-c74472664be2" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-ddbfa81f-0b91-4321-8c35-c74472664be2" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:26 devstack sudo[113712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba Jun 19 04:37:26 devstack sudo[113712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfb486f-93e5-4e21-b2c3-53348e4f20a5]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Acquiring lock "cinder-442d0a85-515e-4833-bbaa-7de1131dbed4-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Lock "cinder-442d0a85-515e-4833-bbaa-7de1131dbed4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Acquiring lock "cinder-quobyte-81bc0563-f8b2-4f69-9258-6a75f5efd155" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Lock "cinder-quobyte-81bc0563-f8b2-4f69-9258-6a75f5efd155" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Acquiring lock "cinder-quobyte-442d0a85-515e-4833-bbaa-7de1131dbed4" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:26 devstack sudo[113714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2 Jun 19 04:37:26 devstack sudo[113714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:26 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Lock "cinder-quobyte-442d0a85-515e-4833-bbaa-7de1131dbed4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Deleting offline snapshot 442d0a85-515e-4833-bbaa-7de1131dbed4 of volume 81bc0563-f8b2-4f69-9258-6a75f5efd155 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:37:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] snapshot_file for this snap is: volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:37:27 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee6dee2-4271-482b-8651-33e1bc190082]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:27 devstack sudo[113716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 Jun 19 04:37:27 devstack sudo[113716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:27 devstack sudo[113712]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba" returned: 0 in 0.887s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b898a27-98b7-4e95-8abb-b9a049a99959(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:37:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:37:27 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Creating direct copy from snapshot {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:37:27 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3efd1e5-2b37-4809-8b51-71c15537e687]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:27 devstack sudo[113721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 Jun 19 04:37:27 devstack sudo[113721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:27 devstack sudo[113714]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2" returned: 0 in 1.021s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:27 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:27 devstack sudo[113726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2 Jun 19 04:37:27 devstack sudo[113726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:28 devstack sudo[113716]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4" returned: 0 in 1.258s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81bc0563-f8b2-4f69-9258-6a75f5efd155(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf049fef-f3bd-4ed5-bf89-2ef5773df94a]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:28 devstack sudo[113731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 Jun 19 04:37:28 devstack sudo[113731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:28 devstack sudo[113721]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959" returned: 0 in 1.179s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG cinder.utils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Path /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b not found in is_blk_device check {{(pid=93530) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:28 devstack sudo[113738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b Jun 19 04:37:28 devstack sudo[113738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:28 devstack sudo[113726]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-ddbfa81f-0b91-4321-8c35-c74472664be2" returned: 0 in 0.925s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-quobyte-ddbfa81f-0b91-4321-8c35-c74472664be2" released by "delete_volume" :: held 2.028s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Created reservations ['a961f9e7-a7b1-4675-897a-46e66d6d22a3', '90065769-b82a-4782-956e-de7194051b6b', '83e8a028-ec7b-4471-90f9-36442f46b872', 'c37529df-1ebb-49ed-933c-65c58ccefc44'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:28 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:28 devstack sudo[113740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:37:28 devstack sudo[113740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:29 devstack sudo[113731]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155" returned: 0 in 0.958s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:29 devstack sudo[113745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 Jun 19 04:37:29 devstack sudo[113745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Flow 'volume_create_manager' (35cac8f0-299c-4a35-86a1-fa7ea14c8588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052da317-1c8b-42a7-b9aa-ef0e408caa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052da317-1c8b-42a7-b9aa-ef0e408caa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1072228319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fcd259f-58c4-4dc0-b2c6-c4336f96e98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e6e0f6df6d04149ab40e62f4355d4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:29Z,use_quota=True,user_id='08c7c9006d7347fdaf2944bac633c3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec443fe-0952-4885-9662-8e45cd6bf92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec443fe-0952-4885-9662-8e45cd6bf92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14eedbc6-a6bc-4529-9395-2b8ae0539db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14eedbc6-a6bc-4529-9395-2b8ae0539db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fcd259f-58c4-4dc0-b2c6-c4336f96e98d', 'volume_name': 'volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beefa2e2-6a25-4e56-97df-bacbb84966bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beefa2e2-6a25-4e56-97df-bacbb84966bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d99b38-e549-404c-a6a8-7a22f9816ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:29 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Volume 4fcd259f-58c4-4dc0-b2c6-c4336f96e98d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d', 'volume_size': 1} Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:29 devstack sudo[113740]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.769s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:37:29 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Deleted volume successfully. Jun 19 04:37:29 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-8c5f19c6-1c19-4c1a-ae15-6fbcfe8bd363 tempest-CreateVolumesFromSnapshotTest-728005157 None] Lock "cinder-ddbfa81f-0b91-4321-8c35-c74472664be2-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:30 devstack sudo[113745]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4" returned: 0 in 1.239s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:30 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:30 devstack sudo[113762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4 Jun 19 04:37:30 devstack sudo[113762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:31 devstack sudo[113762]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:31 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155.442d0a85-515e-4833-bbaa-7de1131dbed4" returned: 0 in 1.407s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:32 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Lock "cinder-quobyte-442d0a85-515e-4833-bbaa-7de1131dbed4" released by "_delete_snapshot" :: held 5.051s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:32 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Lock "cinder-quobyte-81bc0563-f8b2-4f69-9258-6a75f5efd155" released by "delete_snapshot" :: held 5.090s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:32 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Created reservations ['9ff79ef1-530b-4694-90ee-1fd6eaf9912b', 'f4bb1a14-3382-465d-90b2-3718180b84be', '6236758d-f32c-4c37-b5a6-8f69223f6e2c', '9effb513-e6f8-4e2e-bff7-76a49a75a788'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:32 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Delete snapshot completed successfully. Jun 19 04:37:32 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-202e709c-7a8c-4ffa-8150-cefc74192fc8 tempest-CinderUnicodeTest-1135811386 None] Lock "cinder-442d0a85-515e-4833-bbaa-7de1131dbed4-delete_snapshot" released by "delete_snapshot" :: held 5.423s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:32 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Acquiring lock "cinder-81bc0563-f8b2-4f69-9258-6a75f5efd155-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:32 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Lock "cinder-81bc0563-f8b2-4f69-9258-6a75f5efd155-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:32 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Acquiring lock "cinder-quobyte-81bc0563-f8b2-4f69-9258-6a75f5efd155" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:32 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Lock "cinder-quobyte-81bc0563-f8b2-4f69-9258-6a75f5efd155" acquired by "delete_volume" :: waited 0.038s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:32 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[418d4310-2502-4846-bf34-eb46595763cb]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:32 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:33 devstack sudo[113767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 Jun 19 04:37:33 devstack sudo[113767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:34 devstack sudo[113767]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155" returned: 0 in 1.978s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:34 devstack sudo[113738]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b" returned: 0 in 6.197s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:34 devstack sudo[113772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155 Jun 19 04:37:34 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca58c56-b75a-4be0-9017-e5c47de45da9]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:34 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:34 devstack sudo[113772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:34 devstack sudo[113774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 Jun 19 04:37:34 devstack sudo[113774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:35 devstack sudo[113772]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-81bc0563-f8b2-4f69-9258-6a75f5efd155" returned: 0 in 0.670s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:35 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Lock "cinder-quobyte-81bc0563-f8b2-4f69-9258-6a75f5efd155" released by "delete_volume" :: held 2.812s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:35 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Created reservations ['d3b61216-0cb0-499b-b92b-74110745759a', '1d683376-1afa-4792-9a77-d005329cae2c', '3f4d44ee-3ed9-4aaf-82fc-1c52fddb3642', '8dc458a9-3b84-42d9-b252-e1193ce27129'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:35 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:35 devstack sudo[113779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:37:35 devstack sudo[113779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:35 devstack sudo[113774]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959" returned: 0 in 0.898s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:35 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Image conversion details: src /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:37:35 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Converted 1024.00 MB image at 165.20 MB/s Jun 19 04:37:35 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b is being set with open permissions: ugo+rw Jun 19 04:37:35 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:35 devstack sudo[113782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b Jun 19 04:37:35 devstack sudo[113782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Acquiring lock "cinder-da67ee30-b3f4-42e4-adb6-e966f0c6017d-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Lock "cinder-da67ee30-b3f4-42e4-adb6-e966f0c6017d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Acquiring lock "cinder-quobyte-da67ee30-b3f4-42e4-adb6-e966f0c6017d" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Lock "cinder-quobyte-da67ee30-b3f4-42e4-adb6-e966f0c6017d" acquired by "delete_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[300256ee-4544-48d8-b34f-553c033836ab]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:36 devstack sudo[113785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d Jun 19 04:37:36 devstack sudo[113785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:36 devstack sudo[113779]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.716s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:37:36 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Deleted volume successfully. Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-826c9de8-651f-48fa-bd2d-e9502b745fe8 tempest-CinderUnicodeTest-1135811386 None] Lock "cinder-81bc0563-f8b2-4f69-9258-6a75f5efd155-delete_volume" released by "delete_volume" :: held 3.779s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:36 devstack sudo[113782]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b" returned: 0 in 0.696s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Lock "cinder-quobyte-5a2285c2-e12b-44ae-b70e-300578a8be8b" released by "_copy_volume_from_snapshot" :: held 9.995s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Lock "cinder-quobyte-258b34b5-03b4-4798-a2c7-5fa0f352f8ba-5a2285c2-e12b-44ae-b70e-300578a8be8b" released by "_create_volume_from_snapshot" :: held 10.040s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.067s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1072228319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fcd259f-58c4-4dc0-b2c6-c4336f96e98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e6e0f6df6d04149ab40e62f4355d4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:29Z,use_quota=True,user_id='08c7c9006d7347fdaf2944bac633c3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)}" {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Creating volume 4fcd259f-58c4-4dc0-b2c6-c4336f96e98d {{(pid=93530) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:37:36 devstack cinder-volume[93530]: INFO cinder.volume.drivers.remotefs [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] casted to osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d 1073741824 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:36 devstack sudo[113788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d 1073741824 Jun 19 04:37:36 devstack sudo[113788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705057ad-8a79-4f47-9379-ac5112f8cacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2285c2-e12b-44ae-b70e-300578a8be8b', 'volume_size': 1, 'snapshot_id': '258b34b5-03b4-4798-a2c7-5fa0f352f8ba'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a0941a-4318-459b-ad21-40d460539f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:36 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Volume volume-5a2285c2-e12b-44ae-b70e-300578a8be8b (5a2285c2-e12b-44ae-b70e-300578a8be8b): created successfully Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a0941a-4318-459b-ad21-40d460539f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Flow 'volume_create_manager' (86f80e80-8b86-4dfa-a89c-8252c2e21736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:36 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-ef8a0274-ff81-4508-9cc4-f3bebdbf1e9a tempest-VolumeDependencyTests-716483202 None] Created volume successfully. Jun 19 04:37:36 devstack sudo[113785]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d" returned: 0 in 0.754s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:36 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:36 devstack sudo[113793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d Jun 19 04:37:37 devstack sudo[113793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:37 devstack sudo[113788]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d 1073741824" returned: 0 in 0.804s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:37 devstack sudo[113798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d Jun 19 04:37:37 devstack sudo[113798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Acquiring lock "cinder-258b34b5-03b4-4798-a2c7-5fa0f352f8ba-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Lock "cinder-258b34b5-03b4-4798-a2c7-5fa0f352f8ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Acquiring lock "cinder-quobyte-8b898a27-98b7-4e95-8abb-b9a049a99959" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Lock "cinder-quobyte-8b898a27-98b7-4e95-8abb-b9a049a99959" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Acquiring lock "cinder-quobyte-258b34b5-03b4-4798-a2c7-5fa0f352f8ba" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Lock "cinder-quobyte-258b34b5-03b4-4798-a2c7-5fa0f352f8ba" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Deleting offline snapshot 258b34b5-03b4-4798-a2c7-5fa0f352f8ba of volume 8b898a27-98b7-4e95-8abb-b9a049a99959 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] snapshot_file for this snap is: volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[5108389b-b123-41e6-a2b8-7130646bd423]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:37 devstack sudo[113800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba Jun 19 04:37:37 devstack sudo[113800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:37 devstack sudo[113793]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-da67ee30-b3f4-42e4-adb6-e966f0c6017d" returned: 0 in 0.708s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Lock "cinder-quobyte-da67ee30-b3f4-42e4-adb6-e966f0c6017d" released by "delete_volume" :: held 1.506s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Created reservations ['6e37b4cb-d6eb-4ed2-a36a-f6d7e5ef4e2c', '6a89fa60-4050-48dc-a3c6-609e0231bc71', '649fabd1-bb64-4a2b-8081-8b255180ac89', 'd8e7da88-afd2-47eb-b1b1-f9efa7d572d4'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:37 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:37 devstack sudo[113803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:37:37 devstack sudo[113803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:38 devstack sudo[113798]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d" returned: 0 in 0.663s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'} {{(pid=93530) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7d99b38-e549-404c-a6a8-7a22f9816ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d', 'volume_size': 1}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debc6a9c-855e-47c9-9e59-59e6f2e98659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:38 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Volume volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d (4fcd259f-58c4-4dc0-b2c6-c4336f96e98d): created successfully Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debc6a9c-855e-47c9-9e59-59e6f2e98659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Flow 'volume_create_manager' (35cac8f0-299c-4a35-86a1-fa7ea14c8588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:38 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-8ed006dc-51b8-423a-8ab1-993e66b27e3b tempest-SnapshotDependencyTests-184381334 None] Created volume successfully. Jun 19 04:37:38 devstack sudo[113800]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba" returned: 0 in 0.848s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b898a27-98b7-4e95-8abb-b9a049a99959(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd46851a-cf53-4a2c-b6aa-1cf8bfaf1f79]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] Creating offline snapshot 610f14a9-135b-4eca-a074-35a260cc1767 of volume 4fcd259f-58c4-4dc0-b2c6-c4336f96e98d {{(pid=93530) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[d305328b-7374-47d5-9752-f09f4c69afe5]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:38 devstack sudo[113809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 Jun 19 04:37:38 devstack sudo[113809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:38 devstack sudo[113803]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.780s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:37:38 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Deleted volume successfully. Jun 19 04:37:38 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-304e9942-4014-4095-a743-9adf40bc7908 tempest-CinderUnicodeTest-1135811386 None] Lock "cinder-da67ee30-b3f4-42e4-adb6-e966f0c6017d-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:38 devstack sudo[113812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d Jun 19 04:37:38 devstack sudo[113812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:39 devstack sudo[113809]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959" returned: 0 in 0.931s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:39 devstack sudo[113822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba Jun 19 04:37:39 devstack sudo[113822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:39 devstack sudo[113812]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d" returned: 0 in 0.865s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:39 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 1G {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:39 devstack sudo[113824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 1G Jun 19 04:37:39 devstack sudo[113824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:40 devstack sudo[113822]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba" returned: 0 in 0.829s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:40 devstack sudo[113833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba Jun 19 04:37:40 devstack sudo[113833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:40 devstack sudo[113824]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 1G" returned: 0 in 0.894s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:40 devstack sudo[113835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 Jun 19 04:37:40 devstack sudo[113835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:40 devstack sudo[113833]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:40 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959.258b34b5-03b4-4798-a2c7-5fa0f352f8ba" returned: 0 in 0.636s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Lock "cinder-quobyte-258b34b5-03b4-4798-a2c7-5fa0f352f8ba" released by "_delete_snapshot" :: held 3.366s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Lock "cinder-quobyte-8b898a27-98b7-4e95-8abb-b9a049a99959" released by "delete_snapshot" :: held 3.393s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:40 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Created reservations ['8695770f-7a55-4c7d-8a77-d86426b470ec', '3df7b3c6-3b0b-4b37-abd7-4e7e15af680d', 'd1d97b0d-3e50-4db1-badb-ef41ea0ac66b', '719c449b-9eb0-4d22-ab99-33ba64d695d9'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:40 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Delete snapshot completed successfully. Jun 19 04:37:40 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-564d8a73-f37a-4288-9af9-2062d85555a9 tempest-VolumeDependencyTests-716483202 None] Lock "cinder-258b34b5-03b4-4798-a2c7-5fa0f352f8ba-delete_snapshot" released by "delete_snapshot" :: held 3.539s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:41 devstack sudo[113835]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d -F qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767" returned: 0 in 0.700s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:41 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 is being set with open permissions: ugo+rw Jun 19 04:37:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:41 devstack sudo[113841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 Jun 19 04:37:41 devstack sudo[113841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Acquiring lock "cinder-8b898a27-98b7-4e95-8abb-b9a049a99959-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Lock "cinder-8b898a27-98b7-4e95-8abb-b9a049a99959-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:41 devstack sudo[113841]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767" returned: 0 in 0.665s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Acquiring lock "cinder-quobyte-8b898a27-98b7-4e95-8abb-b9a049a99959" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:41 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Lock "cinder-quobyte-8b898a27-98b7-4e95-8abb-b9a049a99959" acquired by "delete_volume" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:41 devstack sudo[113845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.info Jun 19 04:37:41 devstack sudo[113845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:41 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a260047-1a95-4056-bf6f-e646864c1aef]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:41 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:41 devstack sudo[113847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 Jun 19 04:37:41 devstack sudo[113847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:42 devstack sudo[113845]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.info" returned: 0 in 0.629s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:42 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.info is being set with open permissions: ugo+rw Jun 19 04:37:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.info {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:42 devstack sudo[113850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.info Jun 19 04:37:42 devstack sudo[113850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:42 devstack sudo[113847]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959" returned: 0 in 0.734s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:42 devstack sudo[113855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959 Jun 19 04:37:42 devstack sudo[113855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:42 devstack sudo[113850]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:42 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.info" returned: 0 in 0.621s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.487s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:43 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-1e99bb9f-6654-49a1-bc40-8ac9e7a9edd4 tempest-SnapshotDependencyTests-184381334 None] Create snapshot completed successfully Jun 19 04:37:43 devstack sudo[113855]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-8b898a27-98b7-4e95-8abb-b9a049a99959" returned: 0 in 0.652s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Lock "cinder-quobyte-8b898a27-98b7-4e95-8abb-b9a049a99959" released by "delete_volume" :: held 1.445s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Created reservations ['cf246a2f-94ea-4339-9f02-2df14da2f7cd', 'cb94a3a0-280b-48dc-a108-b126899c99d8', '05c20b6f-492b-4ba2-94e2-24ee3b501e38', '415e7b16-c6ef-462b-b341-ca0fc7494a75'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:43 devstack sudo[113859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:37:43 devstack sudo[113859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Acquiring lock "cinder-5a2285c2-e12b-44ae-b70e-300578a8be8b-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Lock "cinder-5a2285c2-e12b-44ae-b70e-300578a8be8b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:43 devstack sudo[113859]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.654s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:37:43 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Deleted volume successfully. Jun 19 04:37:43 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Acquiring lock "cinder-quobyte-5a2285c2-e12b-44ae-b70e-300578a8be8b" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-35363a15-3ecf-4a29-8368-828060fc94a2 tempest-VolumeDependencyTests-716483202 None] Lock "cinder-8b898a27-98b7-4e95-8abb-b9a049a99959-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Lock "cinder-quobyte-5a2285c2-e12b-44ae-b70e-300578a8be8b" acquired by "delete_volume" :: waited 0.028s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a55e120-4207-44df-bdfd-c0cc660c8381]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:44 devstack sudo[113862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b Jun 19 04:37:44 devstack sudo[113862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93530) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Flow 'volume_create_manager' (81e8c6e4-c97b-458d-bf2f-7d08078256f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f75919a-11c0-4f2a-81c3-6170a09b013c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f75919a-11c0-4f2a-81c3-6170a09b013c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:37:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=138d69a8-a06f-4823-a50d-5f91341d2a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e6e0f6df6d04149ab40e62f4355d4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=610f14a9-135b-4eca-a074-35a260cc1767,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:37:44Z,use_quota=True,user_id='08c7c9006d7347fdaf2944bac633c3be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f53edf87-fc4b-4eb9-a5c6-4ac407a321b2),volume_type_id=f53edf87-fc4b-4eb9-a5c6-4ac407a321b2)' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb26eb68-809d-4386-8b9f-2a16aa8c61cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb26eb68-809d-4386-8b9f-2a16aa8c61cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba72a3cc-00af-44bf-81e0-29faec8bb216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba72a3cc-00af-44bf-81e0-29faec8bb216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '138d69a8-a06f-4823-a50d-5f91341d2a28', 'volume_name': 'volume-138d69a8-a06f-4823-a50d-5f91341d2a28', 'volume_size': 1, 'snapshot_id': '610f14a9-135b-4eca-a074-35a260cc1767'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec807b7-8c22-43d2-92db-d547492f9c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec807b7-8c22-43d2-92db-d547492f9c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc1e632-0c1f-4eaa-af48-481be52ca90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:44 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Volume 138d69a8-a06f-4823-a50d-5f91341d2a28: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-138d69a8-a06f-4823-a50d-5f91341d2a28', 'volume_size': 1, 'snapshot_id': '610f14a9-135b-4eca-a074-35a260cc1767'} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "cinder-quobyte-610f14a9-135b-4eca-a074-35a260cc1767-138d69a8-a06f-4823-a50d-5f91341d2a28" by "_create_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-quobyte-610f14a9-135b-4eca-a074-35a260cc1767-138d69a8-a06f-4823-a50d-5f91341d2a28" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Creating volume 138d69a8-a06f-4823-a50d-5f91341d2a28 from snapshot 610f14a9-135b-4eca-a074-35a260cc1767 {{(pid=93530) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Selected osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0 as target Quobyte volume. {{(pid=93530) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "cinder-quobyte-138d69a8-a06f-4823-a50d-5f91341d2a28" by "_copy_volume_from_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-quobyte-138d69a8-a06f-4823-a50d-5f91341d2a28" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] snapshot: 610f14a9-135b-4eca-a074-35a260cc1767, volume: 138d69a8-a06f-4823-a50d-5f91341d2a28, {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a9d335-4fa7-437b-8fb5-de98726139b1]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:44 devstack sudo[113864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 Jun 19 04:37:44 devstack sudo[113864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:44 devstack sudo[113862]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b" returned: 0 in 0.757s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:44 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:44 devstack sudo[113869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b Jun 19 04:37:44 devstack sudo[113869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:45 devstack sudo[113864]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767" returned: 0 in 0.766s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Creating direct copy from snapshot {{(pid=93530) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbac691-7d91-461d-9b3b-422517afa6c2]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:45 devstack sudo[113874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d Jun 19 04:37:45 devstack sudo[113874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:45 devstack sudo[113869]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-5a2285c2-e12b-44ae-b70e-300578a8be8b" returned: 0 in 0.651s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Lock "cinder-quobyte-5a2285c2-e12b-44ae-b70e-300578a8be8b" released by "delete_volume" :: held 1.462s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Created reservations ['35fa51cd-1976-4ba3-9759-603f280a3e72', 'f282db83-cbcc-4039-9c6a-0353af785e40', '4365f840-2fca-4fa6-b2a6-51f64dc5510a', 'e4ae150c-16aa-402c-99f5-4740b3f16355'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:45 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:45 devstack sudo[113877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:37:45 devstack sudo[113877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:46 devstack sudo[113874]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d" returned: 0 in 0.764s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:46 devstack cinder-volume[93530]: DEBUG cinder.utils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Path /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28 not found in is_blk_device check {{(pid=93530) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:37:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:46 devstack sudo[113882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28 Jun 19 04:37:46 devstack sudo[113882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:46 devstack sudo[113877]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:46 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.663s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:46 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:37:46 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Deleted volume successfully. Jun 19 04:37:46 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-0c04fce4-7c31-4528-adf7-9039eefa79c3 tempest-VolumeDependencyTests-716483202 None] Lock "cinder-5a2285c2-e12b-44ae-b70e-300578a8be8b-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:51 devstack sudo[113882]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28" returned: 0 in 5.148s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:51 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46464cb-05ef-4b54-a15d-1f2b843d188c]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:51 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:51 devstack sudo[113932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d Jun 19 04:37:51 devstack sudo[113932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:52 devstack sudo[113932]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d" returned: 0 in 0.942s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:52 devstack cinder-volume[93530]: DEBUG cinder.image.image_utils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Image conversion details: src /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28 {{(pid=93530) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:37:52 devstack cinder-volume[93530]: INFO cinder.image.image_utils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Converted 1024.00 MB image at 198.87 MB/s Jun 19 04:37:52 devstack cinder-volume[93530]: WARNING cinder.volume.drivers.remotefs [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28 is being set with open permissions: ugo+rw Jun 19 04:37:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:52 devstack sudo[113938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28 Jun 19 04:37:52 devstack sudo[113938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:52 devstack sudo[113938]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28" returned: 0 in 0.612s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-quobyte-138d69a8-a06f-4823-a50d-5f91341d2a28" released by "_copy_volume_from_snapshot" :: held 8.330s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:52 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-quobyte-610f14a9-135b-4eca-a074-35a260cc1767-138d69a8-a06f-4823-a50d-5f91341d2a28" released by "_create_volume_from_snapshot" :: held 8.357s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:52 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.372s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc1e632-0c1f-4eaa-af48-481be52ca90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-138d69a8-a06f-4823-a50d-5f91341d2a28', 'volume_size': 1, 'snapshot_id': '610f14a9-135b-4eca-a074-35a260cc1767'}' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f3378e-9f6a-4e28-b295-86038deaa681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:37:52 devstack cinder-volume[93530]: INFO cinder.volume.flows.manager.create_volume [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Volume volume-138d69a8-a06f-4823-a50d-5f91341d2a28 (138d69a8-a06f-4823-a50d-5f91341d2a28): created successfully Jun 19 04:37:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f3378e-9f6a-4e28-b295-86038deaa681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93530) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:37:52 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Flow 'volume_create_manager' (81e8c6e4-c97b-458d-bf2f-7d08078256f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93530) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:37:52 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-c3df3cd6-6808-4b24-8017-a638e79f1a24 tempest-SnapshotDependencyTests-184381334 None] Created volume successfully. Jun 19 04:37:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "cinder-610f14a9-135b-4eca-a074-35a260cc1767-delete_snapshot" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-610f14a9-135b-4eca-a074-35a260cc1767-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "cinder-quobyte-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d" by "delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-quobyte-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "cinder-quobyte-610f14a9-135b-4eca-a074-35a260cc1767" by "_delete_snapshot" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:53 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-quobyte-610f14a9-135b-4eca-a074-35a260cc1767" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Deleting offline snapshot 610f14a9-135b-4eca-a074-35a260cc1767 of volume 4fcd259f-58c4-4dc0-b2c6-c4336f96e98d {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:37:53 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] snapshot_file for this snap is: volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 {{(pid=93530) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:37:53 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[973fb8d5-469d-4156-9da2-709b9020c2eb]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:53 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:53 devstack sudo[113941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 Jun 19 04:37:53 devstack sudo[113941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:54 devstack sudo[113941]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767" returned: 0 in 0.738s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:54 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.remotefs [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93530) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:37:54 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b75447-cff8-4f61-b38f-73a2d8557dff]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:54 devstack sudo[113946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d Jun 19 04:37:54 devstack sudo[113946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:54 devstack sudo[113946]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d" returned: 0 in 0.725s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:54 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:54 devstack sudo[113951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 Jun 19 04:37:54 devstack sudo[113951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:55 devstack sudo[113951]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767" returned: 0 in 0.694s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:55 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:55 devstack sudo[113956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767 Jun 19 04:37:55 devstack sudo[113956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:56 devstack sudo[113956]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d.610f14a9-135b-4eca-a074-35a260cc1767" returned: 0 in 0.653s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-quobyte-610f14a9-135b-4eca-a074-35a260cc1767" released by "_delete_snapshot" :: held 2.899s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-quobyte-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d" released by "delete_snapshot" :: held 2.921s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:56 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Created reservations ['fc4fab45-f786-47d8-a4a3-e71596acf22f', 'd6d223fa-5e17-403b-abc4-27aab96d3c16', 'd2a5c17b-4687-4b64-b6aa-595a115b101f', 'dfe70a1c-0643-4965-8191-9cafc437b020'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:56 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Delete snapshot completed successfully. Jun 19 04:37:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-589b926b-ab8e-49cd-8b3e-cf4ca5af50db tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-610f14a9-135b-4eca-a074-35a260cc1767-delete_snapshot" released by "delete_snapshot" :: held 3.057s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "cinder-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "cinder-quobyte-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:56 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-quobyte-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d" acquired by "delete_volume" :: waited 0.014s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:56 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[8909c720-a9a1-4c3a-8329-63e2519a16fd]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:56 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:56 devstack sudo[113959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d Jun 19 04:37:56 devstack sudo[113959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:57 devstack sudo[113959]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d" returned: 0 in 0.708s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:57 devstack sudo[113964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d Jun 19 04:37:57 devstack sudo[113964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:57 devstack sudo[113964]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d" returned: 0 in 0.608s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:57 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-quobyte-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d" released by "delete_volume" :: held 1.370s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:57 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Created reservations ['7f312b8b-ae64-4f10-a339-cc308c9b6e1d', 'dfb18273-b5fd-40d3-baa5-832ea8cca9c8', 'b1b15a0f-7350-4cbe-8857-1afc957ae184', 'd7706c80-b079-4d30-a983-b7599e5b6229'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:37:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:57 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:57 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:58 devstack sudo[113967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:37:58 devstack sudo[113967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:58 devstack sudo[113967]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.606s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:37:58 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Deleted volume successfully. Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-eae9da39-91e5-41cc-86dd-56974032fe1a tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-4fcd259f-58c4-4dc0-b2c6-c4336f96e98d-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "cinder-138d69a8-a06f-4823-a50d-5f91341d2a28-delete_volume" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-138d69a8-a06f-4823-a50d-5f91341d2a28-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "cinder-quobyte-138d69a8-a06f-4823-a50d-5f91341d2a28" by "delete_volume" {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-quobyte-138d69a8-a06f-4823-a50d-5f91341d2a28" acquired by "delete_volume" :: waited 0.014s {{(pid=93530) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ed4057-6df7-4766-bdfb-4ccce612a794]: (4, 'qcow2') {{(pid=94727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:58 devstack sudo[113970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28 Jun 19 04:37:58 devstack sudo[113970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:37:58 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:58 devstack sudo[113972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:37:58 devstack sudo[113972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:59 devstack sudo[113970]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28" returned: 0 in 0.778s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28 {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:37:59 devstack sudo[113978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28 Jun 19 04:37:59 devstack sudo[113978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:37:59 devstack sudo[113972]: pam_unix(sudo:session): session closed for user root Jun 19 04:37:59 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.631s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:37:59 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:37:59 devstack cinder-volume[93530]: DEBUG oslo_service.periodic_task [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] Running periodic task VolumeManager._thread_info {{(pid=93530) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:37:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread count: 28 {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:37:59 devstack cinder-volume[93530]: DEBUG cinder.volume.manager [None req-dd94ae4a-ef0c-41bd-b475-b66b49a9e934 None None] thread info: [<_MainThread(MainThread, started 133474940932224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93530) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:38:00 devstack sudo[113978]: pam_unix(sudo:session): session closed for user root Jun 19 04:38:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d/volume-138d69a8-a06f-4823-a50d-5f91341d2a28" returned: 0 in 0.624s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:38:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-quobyte-138d69a8-a06f-4823-a50d-5f91341d2a28" released by "delete_volume" :: held 1.438s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:38:00 devstack cinder-volume[93530]: DEBUG cinder.quota [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Created reservations ['c715d90a-bf1e-4c85-8f14-c6c6e1723b1f', '4d846870-0753-4709-a138-ffa42ae42b47', 'bb11f2f8-ca41-4bb3-b082-3ef46dd4ebc2', '499d31b8-2d86-4cee-8368-86b3f5a86b2d'] {{(pid=93530) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:38:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:38:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:38:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0': None} {{(pid=93530) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:38:00 devstack cinder-volume[93530]: DEBUG cinder.volume.drivers.quobyte [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-eb786562-02da-4f67-8376-ed17bb5dcde0'] {{(pid=93530) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:38:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.lockutils [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93530) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:38:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:38:00 devstack sudo[113981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d Jun 19 04:38:00 devstack sudo[113981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:38:00 devstack sudo[113981]: pam_unix(sudo:session): session closed for user root Jun 19 04:38:00 devstack cinder-volume[93530]: DEBUG oslo_concurrency.processutils [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4fd69acc2d515a569ed3dc1a5bcbe18d" returned: 0 in 0.638s {{(pid=93530) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:38:00 devstack cinder-volume[93530]: DEBUG cinder.manager [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Notifying Schedulers of capabilities ... {{(pid=93530) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:38:00 devstack cinder-volume[93530]: INFO cinder.volume.manager [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Deleted volume successfully. Jun 19 04:38:00 devstack cinder-volume[93530]: DEBUG cinder.coordination [None req-3e02e731-28ae-4dc0-bde3-c6095872d3ef tempest-SnapshotDependencyTests-184381334 None] Lock "cinder-138d69a8-a06f-4823-a50d-5f91341d2a28-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=93530) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:38:10 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:SELECT=86,cinder:INSERT=30,cinder:UPDATE=101,cinder:DELETE=7 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:38:10 devstack cinder-volume[93530]: DEBUG dbcounter [-] [93530] Writing DB stats cinder:DELETE=8,cinder:SELECT=70,cinder:INSERT=22,cinder:UPDATE=99 {{(pid=93530) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}